-- Logs begin at Sun 2022-09-25 00:10:34 UTC, end at Sun 2022-09-25 01:23:04 UTC. -- Sep 25 00:50:40.394967 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 25 00:50:40.405995 dv-cinder-master-3-smb devstack@n-api.service[105614]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 00:50:40 2022] *** Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: nodename: dv-cinder-master-3-smb Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: machine: x86_64 Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: clock source: unix Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: pcre jit disabled Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: detected number of CPU cores: 4 Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: current working directory: / Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: detected binary path: /usr/bin/uwsgi-core Sep 25 00:50:40.408100 dv-cinder-master-3-smb devstack@n-api.service[105614]: your processes number limit is 47680 Sep 25 00:50:40.408888 dv-cinder-master-3-smb devstack@n-api.service[105614]: your memory page size is 4096 bytes Sep 25 00:50:40.408888 dv-cinder-master-3-smb devstack@n-api.service[105614]: detected max file descriptor number: 2048 Sep 25 00:50:40.408888 dv-cinder-master-3-smb devstack@n-api.service[105614]: lock engine: pthread robust mutexes Sep 25 00:50:40.408888 dv-cinder-master-3-smb devstack@n-api.service[105614]: thunder lock: enabled Sep 25 00:50:40.408888 dv-cinder-master-3-smb devstack@n-api.service[105614]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 25 00:50:40.408888 dv-cinder-master-3-smb devstack@n-api.service[105614]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 00:50:40.448598 dv-cinder-master-3-smb devstack@n-api.service[105614]: Python main interpreter initialized at 0x556515f989c0 Sep 25 00:50:40.448598 dv-cinder-master-3-smb devstack@n-api.service[105614]: python threads support enabled Sep 25 00:50:40.448598 dv-cinder-master-3-smb devstack@n-api.service[105614]: your server socket listen backlog is limited to 100 connections Sep 25 00:50:40.448598 dv-cinder-master-3-smb devstack@n-api.service[105614]: your mercy for graceful operations on workers is 90 seconds Sep 25 00:50:40.449036 dv-cinder-master-3-smb devstack@n-api.service[105614]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 00:50:40.449036 dv-cinder-master-3-smb devstack@n-api.service[105614]: *** Operational MODE: preforking *** Sep 25 00:50:40.449315 dv-cinder-master-3-smb devstack@n-api.service[105614]: *** uWSGI is running in multiple interpreter mode *** Sep 25 00:50:40.449315 dv-cinder-master-3-smb devstack@n-api.service[105614]: spawned uWSGI master process (pid: 105614) Sep 25 00:50:40.449525 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 25 00:50:40.451262 dv-cinder-master-3-smb devstack@n-api.service[105614]: spawned uWSGI worker 1 (pid: 105627, cores: 1) Sep 25 00:50:40.451262 dv-cinder-master-3-smb devstack@n-api.service[105614]: spawned uWSGI worker 2 (pid: 105628, cores: 1) Sep 25 00:50:40.451262 dv-cinder-master-3-smb devstack@n-api.service[105614]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 00:50:41.141315 dv-cinder-master-3-smb devstack@n-api.service[105628]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:50:41.143264 dv-cinder-master-3-smb devstack@n-api.service[105627]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:50:42.254449 dv-cinder-master-3-smb devstack@n-api.service[105627]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:50:42.254449 dv-cinder-master-3-smb devstack@n-api.service[105627]: from cryptography.utils import int_from_bytes Sep 25 00:50:42.255207 dv-cinder-master-3-smb devstack@n-api.service[105627]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:50:42.255207 dv-cinder-master-3-smb devstack@n-api.service[105627]: from cryptography.utils import int_from_bytes Sep 25 00:50:42.255366 dv-cinder-master-3-smb devstack@n-api.service[105628]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:50:42.255366 dv-cinder-master-3-smb devstack@n-api.service[105628]: from cryptography.utils import int_from_bytes Sep 25 00:50:42.255366 dv-cinder-master-3-smb devstack@n-api.service[105628]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:50:42.255366 dv-cinder-master-3-smb devstack@n-api.service[105628]: from cryptography.utils import int_from_bytes Sep 25 00:50:44.846509 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:50:44.847460 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:50:44.847886 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:50:44.848365 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:50:44.848766 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:50:44.849259 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.849736 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.850169 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.850604 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.851756 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.852086 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.852630 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.853070 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.853571 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.853945 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.854106 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:50:44.854817 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.854980 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:50:44.855152 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.855514 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:50:44.855690 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.856005 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.856169 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:50:44.856576 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.856768 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:50:44.857086 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.857337 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.857607 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.857930 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.858129 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.858527 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.858696 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.859119 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.859441 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.859740 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.860057 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.860256 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.860807 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.860973 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.861176 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.861369 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.861613 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.861768 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.862073 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.862287 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.862526 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.862764 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.862916 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.863063 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.863376 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.863544 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.863834 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.864009 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.864252 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.864439 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.864606 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.864926 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.865115 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.865331 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.865599 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.865934 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.866198 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.866480 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.866647 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.867426 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.867671 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.867909 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.868311 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.868531 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.868841 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.869008 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.869330 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.869503 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.869821 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.869975 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.870316 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.870483 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.870823 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.870997 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.871339 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.871499 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.871848 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.872131 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.872416 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.872752 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.872968 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.873331 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.873502 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.873844 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.874009 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.874329 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.874693 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.874875 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.875247 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.875402 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.875732 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.875891 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.876148 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.876438 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.876711 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.877034 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.877273 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.877604 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.877776 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.878192 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.878352 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.878606 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.878778 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.879025 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.879369 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.879527 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.879954 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.880110 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.880493 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.880681 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.880991 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.881157 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.881482 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.881672 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.881984 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.882244 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.882549 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.882852 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.883071 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.883343 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.883594 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.883772 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.884166 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.884333 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.884729 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.884887 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.885227 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.885384 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.885717 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.885966 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.886222 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.886434 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.886744 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.886911 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.887367 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.887526 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.887788 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.888045 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.888311 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.888656 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.888898 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.889238 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.889393 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.889806 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.889962 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.890297 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.890466 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.890793 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.890950 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.891281 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.891480 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.891783 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.892061 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.892277 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.892670 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.892906 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.893241 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.893458 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.893766 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.893930 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.894190 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.894360 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.894678 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.894903 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.895176 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.895503 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.895680 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.896087 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.896280 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.896630 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.896804 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.897122 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.897410 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.897940 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.898297 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.898478 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.898837 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.898993 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.899355 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.899509 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.899833 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.899998 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.900319 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.900609 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.900857 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.901179 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.901344 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.901739 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.901895 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.902225 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.902453 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.902732 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.902938 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.903263 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.903428 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.903790 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.903960 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.904278 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.904495 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.904830 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.905060 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.905356 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.905526 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.905841 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.906068 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.906380 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.906640 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.906889 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.907211 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.907368 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.907753 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.907996 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.908281 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.908523 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.908883 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.909050 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.909392 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.909550 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.909914 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.910090 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.910401 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.910569 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.910904 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.911072 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.911390 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.911558 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.911880 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.912124 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.912450 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.912732 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.912920 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.913316 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.913473 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.914339 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.914495 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.914818 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.914991 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.915305 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.915463 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.915783 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.915988 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.916275 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.916592 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.916814 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.917146 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.917306 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.917713 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.917869 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.918219 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.918375 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.918699 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.918910 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.919200 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.919400 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.919706 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.919963 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.920216 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.920579 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.920861 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.921142 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.921385 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.921725 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.921909 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.922299 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.922455 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.922848 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.923006 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.923361 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.923570 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.923882 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.924039 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.924406 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.924640 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.924923 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.925145 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.925446 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.925700 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.925960 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.926269 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.926460 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.926833 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.926992 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.927367 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.927521 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.927855 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.928012 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.928366 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.928590 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.928910 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.929133 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.929490 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.929713 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.930003 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.930280 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.930509 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.930876 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.931035 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.931425 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.931597 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.931932 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.932110 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.932459 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.932617 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.932983 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.933154 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.933513 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.933736 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:50:44.934024 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.934328 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.934606 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.934936 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.935092 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.935488 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.935659 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.935983 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.936141 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.936512 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.936750 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.937053 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.937355 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.937546 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.937929 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.938086 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.938474 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.938642 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.938966 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.939123 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.939489 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.939649 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.939982 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.940199 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.940539 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.940801 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.941043 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.941389 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.941567 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.941948 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.942113 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.942468 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.942626 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.942968 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.943139 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.943476 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.943678 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.943991 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.944245 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.944541 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.945486 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.945646 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.946052 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.946210 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.946571 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.946745 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.948630 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.949013 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.949170 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.949343 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.949496 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.949650 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.949785 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.949933 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.950082 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.950234 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.950393 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.950561 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.950710 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.950856 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.951063 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.951380 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.951550 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.951958 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.952119 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.952513 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.952672 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.953005 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.953188 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.953506 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.953752 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.954040 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.954278 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.954547 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.954771 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.955089 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.955302 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.955599 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.955875 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.956105 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.956519 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.956699 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.957075 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.957232 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.957558 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.957731 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.958070 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.958228 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.958550 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.958765 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.959049 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.959337 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.959563 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.959970 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.960156 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.960609 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.960768 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.961106 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.961267 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.961603 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.961776 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.962117 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.962367 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.962638 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.962960 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.963117 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.963538 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.963712 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.964077 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.964287 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.964607 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.964766 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.965109 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.965269 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.965618 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.965833 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.966127 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.966399 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.966629 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.966976 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.967148 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.967522 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.967690 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.968013 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.968171 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.968535 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.968751 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.969045 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.969326 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.969542 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.969952 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.970136 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.970438 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.970606 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.970922 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.971094 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.971408 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.971650 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.971942 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.972235 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.972474 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.972839 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.972996 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.973396 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.973554 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.973879 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.974038 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.974408 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.974551 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.974886 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.975124 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.975453 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.975706 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.975988 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.976859 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.977065 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.977461 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.977618 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.977980 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.978134 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.978488 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.978646 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.978974 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.979130 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.979470 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.979710 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.979984 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.980302 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.980585 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.980913 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.981072 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.981442 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.981619 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.981949 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.982125 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.982449 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.982666 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.982987 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.983255 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.983495 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.983880 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.984039 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.984415 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.984762 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.985073 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.985232 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.985620 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.985792 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.986139 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.986311 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.986641 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.986836 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.987156 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.987403 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.987661 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.987976 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.988165 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.988540 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.988696 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.989102 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.989281 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.989601 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.989756 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.990086 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.990245 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.990574 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.990754 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.991076 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.991251 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.991582 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.991810 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.992142 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.992443 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.992714 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.992980 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.993226 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.993600 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.993758 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.994135 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.994305 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.994630 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.994841 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.995175 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.995334 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.995695 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.995868 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.996185 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.996432 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.996728 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.997006 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.997249 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.997646 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.997801 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.998140 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.998294 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.998625 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.998843 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.999118 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.999454 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:44.999608 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.000010 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.000188 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.000545 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.000706 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.001036 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.001219 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.001534 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.001781 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.002038 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.002372 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.002528 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.002933 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.003105 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.003427 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.003584 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.003907 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.004066 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.004450 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.004629 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.004948 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.005174 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.005483 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.005759 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.006001 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.006339 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.006497 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.006905 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.007060 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.007924 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.008068 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.008449 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.008671 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.008956 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.009263 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.009439 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.009869 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.010026 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.010347 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.010506 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.010878 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.011049 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.011383 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.011593 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.011879 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.012190 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.012408 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.012811 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.012986 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.013332 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.013505 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.013830 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.013989 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.014314 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.014528 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.014819 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.015128 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.015339 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.015716 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.015935 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.016300 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.016488 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.016824 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.016995 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.017316 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.017496 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.017818 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.018093 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.018322 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.018697 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.018856 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.019255 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.019411 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.019739 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.019896 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.020223 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.020454 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.020754 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.021071 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.021273 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.021646 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.021804 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.022220 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.022541 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.023141 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.023400 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.023704 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.023903 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.024251 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.024456 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.024865 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.025025 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.025385 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.025556 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.025927 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.026147 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.026433 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.026601 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.026848 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.027013 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.027403 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.027573 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.027896 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.028055 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.028451 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.028611 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.028900 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.029080 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.029410 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.029566 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.029891 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.030132 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.030395 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.030676 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.030919 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.031254 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.031413 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.031826 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.032003 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.032230 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.032430 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.032646 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.032907 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.033075 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.033394 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.033558 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.033731 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.033949 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.034220 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.034457 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.034628 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.034959 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.035119 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.035441 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.035653 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.035974 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.036149 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.036546 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.036708 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.037038 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.037253 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.037547 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.037811 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.038042 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.038384 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.039104 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.039492 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.039664 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.040034 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.040192 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.040572 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.040727 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.041088 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.041269 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.041579 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.041737 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.042064 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.042264 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.042581 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.042828 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.043083 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.043378 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.043579 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.043937 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.044107 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.044521 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.044676 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.045006 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.045165 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.045484 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.045661 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.045981 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.046140 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.046471 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.046701 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.046978 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.047257 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.047486 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.047791 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.047959 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.048355 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.048536 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.048894 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.049049 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.049391 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.049549 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.049880 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.050303 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.050568 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.050802 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.051192 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.051349 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.051720 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.051892 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.052204 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.052410 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.052732 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.052936 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.053244 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.053514 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.053769 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.054163 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.054848 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.055215 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.055381 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.055703 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.055875 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.056194 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.056488 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.056771 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.056931 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.057252 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.057519 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.057827 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.058042 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.058340 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.058620 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.058842 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.059192 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.059347 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.059743 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.059899 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.060221 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.060437 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.060745 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.060965 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.061255 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.061494 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.061779 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.062072 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.062292 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.062638 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.062795 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.063183 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.063350 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.063675 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.063837 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.064162 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.064360 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.064697 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.064990 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.065194 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.065519 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.065686 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.066079 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.066236 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.066565 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.066821 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.067046 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.067201 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.067484 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.067642 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.067961 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.068119 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.068547 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.068706 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.069025 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.069182 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.069524 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.069684 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.070542 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.070812 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.071094 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.071436 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.071607 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.072012 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.072169 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.072550 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.072708 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.073046 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.073204 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.073539 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.073710 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.074039 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.074272 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.074562 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.074722 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.075046 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.075221 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.075538 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.075744 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.076081 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.076287 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.076525 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.076725 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.076992 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.077172 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.077529 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.077700 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.078001 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.078157 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.078395 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.078650 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.078935 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.079151 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.079476 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.079634 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.080041 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.080214 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.080505 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.080661 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.080865 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.081151 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.081348 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.081657 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.081882 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.082188 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.082442 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.082694 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.083004 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.083271 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.083566 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.083764 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.084117 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.084332 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.084684 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.084842 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.085207 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.085364 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.085780 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.085931 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.086764 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.086975 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.087290 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.087448 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.087638 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.087869 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.088171 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.088410 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.088764 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.088923 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.089297 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.089454 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.089821 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.089981 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.090308 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.090480 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.090794 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.090973 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.091280 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.091435 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.091699 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.091879 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.092026 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.092310 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.092552 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.092818 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.092973 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.093149 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.093514 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.093693 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.094010 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.094153 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.094481 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.094641 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.094962 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.095135 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.095454 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.095594 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.095923 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.096061 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.096424 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.096650 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.096824 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.097023 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.097275 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.097508 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.097828 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.098152 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.098364 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.098683 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.098905 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.099212 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.099425 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.099740 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.099899 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.100223 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.100409 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.100740 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.100920 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.101239 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.101395 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.101759 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.101916 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.102244 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.102458 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.102744 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.102918 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.103196 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.103365 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.103643 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.103811 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.104183 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.104342 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.104647 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.104804 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.105197 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.105387 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.105672 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.105888 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.106113 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.106389 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.106566 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.106959 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.107168 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.107487 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.107648 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.107978 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.108144 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.108533 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.108693 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.109012 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.109168 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.109393 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.109598 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.109968 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.110125 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.110496 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.110652 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.110849 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.111060 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.111216 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.111511 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.111678 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.111827 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.112108 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.112265 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.112466 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.112686 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.112841 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.113147 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.113316 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.113465 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.113705 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.113874 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.114215 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.114387 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.114719 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.114887 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.115215 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.115371 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.115689 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.115861 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.116074 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.116413 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.116668 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.116975 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.117201 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.117515 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.117673 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.118020 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.118189 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.118520 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.118755 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.119029 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.119188 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.119505 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.119670 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.119973 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.120153 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.120301 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.120572 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.120739 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.120973 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.121161 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.121503 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.121659 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.122027 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.122186 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.122462 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.122629 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.122848 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.123044 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.123215 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.123544 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.123916 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.124087 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.124480 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.124657 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.124821 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.125053 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.125221 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.125542 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.125700 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.126039 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.126211 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.126539 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.126719 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.126924 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.127110 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.127286 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.127553 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.127705 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.127853 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.128153 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.128479 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.128653 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.128870 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.129021 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.129275 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.129459 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.129620 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.129831 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.129987 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.130311 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.130470 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.130679 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.130844 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.130993 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.131326 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.131483 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.131645 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.131894 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.132071 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.132827 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.132988 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.133164 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.133489 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.133659 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.133824 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.134060 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.134216 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.134463 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.134615 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.134790 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.135107 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.135275 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.135425 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.135673 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.135829 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.136089 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.136248 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.136419 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.136759 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.136931 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.137151 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.137317 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.137467 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.137796 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.137951 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.138129 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.138367 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.138536 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.138745 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.138946 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.139100 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.139365 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.139520 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.139689 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.139937 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.140096 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.140289 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.140542 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.140715 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.140935 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.141086 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.141243 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.141535 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.141692 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.141855 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.142074 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.142229 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.142475 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.142624 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.142785 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.143085 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.143243 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.143435 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.143644 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.143785 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.144063 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.144222 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.144486 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.144833 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.144979 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.145129 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.145271 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.145404 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.145623 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.145770 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.145976 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.146245 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.146401 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.146609 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.146772 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.146926 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.147277 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.147434 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.147855 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.148778 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.148927 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.149137 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.149284 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.149432 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.149757 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.149912 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.150071 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.150332 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.150491 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.150701 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.150900 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.151056 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.151319 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.151471 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.151619 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.151932 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.152087 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.152247 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.152507 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.152685 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.152872 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.153078 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.153245 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.153482 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.153644 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.153793 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.154111 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.154280 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.154424 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.154649 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.154789 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.155100 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.155255 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.155408 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.155640 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.155792 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.155992 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.156273 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.156487 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.156676 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.157044 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.157213 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.157404 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.157699 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.157870 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.158086 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.158289 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.158441 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.158722 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.158876 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.159047 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.159319 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.159476 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.159661 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.159874 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.160044 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.160289 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.160540 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.160691 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.160946 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.161101 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.161439 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.161606 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.161857 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.162008 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.162185 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.162481 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.162652 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.162801 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.163049 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.163215 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.163438 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.164212 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.164406 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.164699 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.164855 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.165059 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.165301 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.165498 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.165698 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.165844 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.166050 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.166255 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.166422 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.166720 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.166886 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.167035 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.167301 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.167458 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.167665 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.167915 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.168076 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.168409 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.168576 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.168781 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.168974 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.169130 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.169435 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.169602 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.169752 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.170012 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.170185 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.170370 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.170578 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.170751 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.171000 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.171173 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.171322 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.171618 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.171777 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.171938 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.172171 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.172342 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.172599 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.172757 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.172891 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.173224 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.173381 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.173553 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.173771 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.173925 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.174187 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.174340 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.174614 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.174839 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.175072 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.175368 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.175602 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.175757 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.175971 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.176128 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.176372 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.176551 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.176699 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.177038 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.177193 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.177376 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.177603 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.177772 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.178006 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.178321 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.178633 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.178789 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.178935 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.179313 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.179595 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.179753 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.179963 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.180141 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.180299 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.180625 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.180779 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.181186 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.181344 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.181541 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.181757 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.181913 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.182199 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.182353 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.182513 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.182803 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.182959 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.183143 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.183378 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.183535 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.183775 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.183912 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.184087 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.184411 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.184592 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.184726 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.184956 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.185097 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.185335 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.185484 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.185630 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.185953 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.186093 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.186262 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.186496 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.186652 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.186881 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.187137 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.187279 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.187518 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.187664 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.187809 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.188128 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.188269 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.188470 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.188711 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.188854 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.189085 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.189399 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.189641 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.189800 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.190014 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.190233 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.190403 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.190629 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.190791 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.190963 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.191246 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.191416 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.191613 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.191847 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.192000 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.192231 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.192474 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.192669 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.192896 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.193059 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.193208 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.193472 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.193639 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.193802 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.194017 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.194174 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.194444 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.194609 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.195431 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.195633 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.195803 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.195952 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.196187 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.196571 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.196754 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.196895 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.197054 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.197211 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.197533 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.197690 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.197884 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.198094 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.198265 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.198486 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.198637 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.198837 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.199116 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.199271 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.199415 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.199691 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.199847 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.200051 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.200254 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.200499 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.200681 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.200829 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.200979 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.201305 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.201472 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.201622 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.201841 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.201998 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.202231 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.202398 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.202546 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.202852 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.203007 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.203157 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.203384 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.203547 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.203780 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.203917 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.204135 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.204402 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.204565 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.204803 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.204952 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.205127 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.205439 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.205580 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.205757 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.205983 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.206152 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.206377 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.206529 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.206758 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.207004 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.207159 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.207342 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.207619 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.207777 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.207966 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.208176 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.208639 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.208796 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.209033 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.209236 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.209420 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.209690 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.209843 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.209993 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.210277 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.210509 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.210720 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.210932 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.211084 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.211368 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.211505 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.211693 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.211969 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.212150 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.212369 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.212553 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.212731 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.213068 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.213224 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.213372 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.213668 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.213827 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.213975 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.214223 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.214381 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.214600 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.214918 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.215135 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.215304 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.215524 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.215718 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.215856 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.216138 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.216294 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.216496 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.216774 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.216988 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.217145 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.217375 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.217517 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.217666 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.217899 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.218041 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.218273 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.218425 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.218587 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.218881 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.219047 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.219180 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.219454 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.219666 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.219820 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.220015 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.220157 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.220406 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.220581 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.220719 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.220999 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.221155 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.221340 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.221622 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.221780 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.221996 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.222161 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.222410 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.222661 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.222983 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.223147 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.223545 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.223718 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.224044 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.224199 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.224569 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.224729 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.225047 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.225260 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.225548 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.225843 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.226083 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.226462 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.226634 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.227000 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.227167 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.227524 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.227682 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.228020 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.228193 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.228475 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.228628 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.228810 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.229113 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.229388 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.229660 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.229982 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.230162 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.230578 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.230787 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.231087 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.231259 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.231578 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.231748 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.232074 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.232324 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.232639 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.232961 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.233121 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.233538 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.233707 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.234155 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.234508 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.234727 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.235016 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.235349 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.235508 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.235928 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.236086 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.236465 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.236621 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.236982 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.237145 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.237511 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.237644 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.237885 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.238249 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.238406 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.238797 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.238976 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.239313 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.239562 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.239864 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.240071 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.240410 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.240728 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.240935 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.241352 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.241516 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.242356 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.242529 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.242861 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.243161 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.243359 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.243775 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.243934 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.244271 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.244478 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.244796 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.245053 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.245295 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.245720 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.245902 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.246208 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.246363 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.246692 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.246959 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.247219 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.247589 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.247748 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.248138 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.248294 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.248660 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.248836 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.249148 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.249414 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.249648 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.249890 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105628) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:50:45.250165 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.250595 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.251011 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.251438 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.251853 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.252265 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.252738 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.253170 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.253585 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.254032 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.254475 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.254900 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.255343 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.255764 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.256198 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.256657 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.257091 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.258186 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.258747 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.259139 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.259915 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.260219 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.260681 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.261106 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.261538 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.261964 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.262379 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.262816 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.263272 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.263687 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.264129 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.264608 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.265052 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.265487 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.265908 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.266398 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.266824 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.267250 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.267678 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.268098 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.268568 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.269010 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.269429 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.269849 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.270300 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.270756 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.271233 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.271670 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.272091 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.272816 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.273787 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.274249 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.274686 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.275144 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.275578 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.275997 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.276454 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.276868 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:50:45.277229 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105627) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:50:45.423975 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO dbcounter [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Registered counter for database nova_api Sep 25 00:50:45.434851 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO dbcounter [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Registered counter for database nova_api Sep 25 00:50:45.452511 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_db.sqlalchemy.engines [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.460887 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.462107 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writer thread running {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:45.468758 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:45.530600 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.context [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c40cf22-5cbd-4586-b2d3-96f125e105b5(cell1) {{(pid=105628) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:50:45.535202 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:50:45.535997 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:50:45.537810 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.context [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c40cf22-5cbd-4586-b2d3-96f125e105b5(cell1) {{(pid=105627) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:50:45.539031 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:50:45.540352 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:50:45.541144 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:50:45.541925 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:50:45.542444 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:50:45.544042 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:50:45.544840 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:50:45.544960 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:50:45.545300 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:50:45.547327 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO dbcounter [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Registered counter for database nova_cell0 Sep 25 00:50:45.547512 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_concurrency.lockutils [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105627) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:50:45.549491 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO dbcounter [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Registered counter for database nova_cell0 Sep 25 00:50:45.551979 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO dbcounter [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Registered counter for database nova_cell1 Sep 25 00:50:45.554005 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO dbcounter [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Registered counter for database nova_cell1 Sep 25 00:50:45.561200 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_db.sqlalchemy.engines [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.563174 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.564619 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.567901 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writer thread running {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:45.568598 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_db.sqlalchemy.engines [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.571433 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:45.723834 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writer thread running {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:45.736290 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO dbcounter [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Registered counter for database nova_cell0 Sep 25 00:50:45.747511 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_db.sqlalchemy.engines [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105628) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.748041 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:45.754024 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writer thread running {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:45.774004 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO dbcounter [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Registered counter for database nova_cell0 Sep 25 00:50:45.796050 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG oslo_db.sqlalchemy.engines [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105627) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:50:45.804871 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writer thread running {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:50:46.113805 dv-cinder-master-3-smb devstack@n-api.service[105628]: WARNING keystonemiddleware.auth_token [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:50:46.122462 dv-cinder-master-3-smb devstack@n-api.service[105628]: WARNING keystonemiddleware.auth_token [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:50:46.177773 dv-cinder-master-3-smb devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:50:46.186478 dv-cinder-master-3-smb devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:50:46.488892 dv-cinder-master-3-smb devstack@n-api.service[105628]: WARNING keystonemiddleware.auth_token [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:50:46.496749 dv-cinder-master-3-smb devstack@n-api.service[105628]: WARNING keystonemiddleware.auth_token [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:50:46.502537 dv-cinder-master-3-smb devstack@n-api.service[105628]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556515f989c0 pid: 105628 (default app) Sep 25 00:50:46.504893 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:50:46.506142 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] 10.222.0.26 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001982 Sep 25 00:50:46.506576 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 1/1] 10.222.0.26 () {50 vars in 788 bytes} [Sun Sep 25 00:50:46 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:50:46.600399 dv-cinder-master-3-smb devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:50:46.606583 dv-cinder-master-3-smb devstack@n-api.service[105627]: WARNING keystonemiddleware.auth_token [None req-905dc6c5-0a44-4efb-9ce9-4a1ba4c2142d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:50:46.611909 dv-cinder-master-3-smb devstack@n-api.service[105627]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x556515f989c0 pid: 105627 (default app) Sep 25 00:52:33.766970 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:33.768312 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002358 Sep 25 00:52:33.768763 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 2/2] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:52:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 00:52:33.782993 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:33.784629 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_cell1:SELECT=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:33.785740 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_cell0:SELECT=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:33.786643 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_cell0:SELECT=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:35.400404 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-1e2795f0-7be8-4128-aed3-52a1c43e88d5 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:35.441072 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-1e2795f0-7be8-4128-aed3-52a1c43e88d5 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.664321 Sep 25 00:52:35.441933 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 1/3] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Sep 25 00:52:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1667 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:52:39.386192 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:39.387723 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-1def5b14-873b-4c6e-a5db-ba0792c3b4a0 None None] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002241 Sep 25 00:52:39.388951 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 3/4] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:52:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:40.039233 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-752d9c28-a776-4d75-a818-aba13be174e5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "name": "cirros256", "rxtx_factor": 1.0, "vcpus": 1, "ram": 256, "id": "c1", "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:40.115171 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-752d9c28-a776-4d75-a818-aba13be174e5 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.715778 Sep 25 00:52:40.115772 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 2/5] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:52:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:40.131301 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_api:SELECT=3 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:40.132542 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_cell0:SELECT=3 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:40.134839 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_cell1:SELECT=3 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:40.135691 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:52:40.350969 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-2d4976ad-6199-4680-8a16-183044634f0c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:40.454866 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-2d4976ad-6199-4680-8a16-183044634f0c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.329163 Sep 25 00:52:40.455834 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 4/6] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Sep 25 00:52:40 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:52:44.041835 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-752d9c28-a776-4d75-a818-aba13be174e5 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:44.043789 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-752d9c28-a776-4d75-a818-aba13be174e5 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002539 Sep 25 00:52:44.051744 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 3/7] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:52:44 2022] GET /compute/v2.1 => generated 388 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:45.137861 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-fca315db-39f7-4636-bfbc-f2bccc1ef2f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 5, "name": "ds512M", "id": "d1", "ram": 512, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:45.194615 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-fca315db-39f7-4636-bfbc-f2bccc1ef2f6 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 1.140507 Sep 25 00:52:45.195499 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 5/8] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:52:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 1143 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:45.210900 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4f7dd232-73d2-4d6a-b981-36b8a84642f2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:45.261990 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4f7dd232-73d2-4d6a-b981-36b8a84642f2 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.055779 Sep 25 00:52:45.263123 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 4/9] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Sep 25 00:52:45 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:52:48.874755 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-fca315db-39f7-4636-bfbc-f2bccc1ef2f6 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:48.876283 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-fca315db-39f7-4636-bfbc-f2bccc1ef2f6 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002038 Sep 25 00:52:48.876792 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 6/10] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:52:48 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:49.492823 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-05433421-e4e8-454a-85af-3204d0b90913 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "ds1G", "ram": 1024, "disk": 10, "swap": 0, "id": "d2", "rxtx_factor": 1.0}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:49.520321 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-05433421-e4e8-454a-85af-3204d0b90913 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.636142 Sep 25 00:52:49.520936 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 5/11] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:52:48 2022] POST /compute/v2.1/flavors => generated 404 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:49.534991 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e51b18a1-c206-48b7-be5a-a225f2236dea admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:49.568370 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-e51b18a1-c206-48b7-be5a-a225f2236dea admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.037946 Sep 25 00:52:49.569136 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 7/12] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Sep 25 00:52:49 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:52:52.672653 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-05433421-e4e8-454a-85af-3204d0b90913 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:52.674725 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-05433421-e4e8-454a-85af-3204d0b90913 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003732 Sep 25 00:52:52.675156 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 6/13] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:52:52 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:53.279480 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-9c3b102f-27d2-48b8-896e-699149a20624 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 2, "swap": 0, "id": "d3", "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 10, "ram": 2048}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:53.306139 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-9c3b102f-27d2-48b8-896e-699149a20624 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.624084 Sep 25 00:52:53.306926 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 8/14] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:52:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:53.320989 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-69fcac03-5223-43ae-83f0-58ae49a26292 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:53.367811 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-69fcac03-5223-43ae-83f0-58ae49a26292 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.050933 Sep 25 00:52:53.383037 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 7/15] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Sep 25 00:52:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:52:56.852358 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-9c3b102f-27d2-48b8-896e-699149a20624 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:52:56.853420 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-9c3b102f-27d2-48b8-896e-699149a20624 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001525 Sep 25 00:52:56.853830 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 9/16] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:52:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:52:57.508778 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-a0f2800d-62da-4f40-9c04-ab9e5f4b257c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "ds4G", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 4096, "disk": 20, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "swap": 0, "id": "d4"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:57.531895 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-a0f2800d-62da-4f40-9c04-ab9e5f4b257c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.671019 Sep 25 00:52:57.533018 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 8/17] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:52:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 673 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:52:57.549517 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-146196ee-f38a-404b-9eae-ca0ca0d3822f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:52:57.589351 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-146196ee-f38a-404b-9eae-ca0ca0d3822f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.046031 Sep 25 00:52:57.590246 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 10/18] 10.222.0.26 () {64 vars in 1336 bytes} [Sun Sep 25 00:52:57 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:53:00.906589 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-a0f2800d-62da-4f40-9c04-ab9e5f4b257c admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:00.908048 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-a0f2800d-62da-4f40-9c04-ab9e5f4b257c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002027 Sep 25 00:53:00.908815 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 9/19] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:53:00 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:01.569557 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-de71bae7-d8b3-4d89-a363-a0db66207c52 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:01.600479 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-de71bae7-d8b3-4d89-a363-a0db66207c52 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.684312 Sep 25 00:53:01.601122 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 11/20] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Sep 25 00:53:00 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 686 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:05.175602 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-a0f2800d-62da-4f40-9c04-ab9e5f4b257c admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:05.177542 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-a0f2800d-62da-4f40-9c04-ab9e5f4b257c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002751 Sep 25 00:53:05.178373 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 10/21] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:53:05 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:05.752841 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e9482a3b-c7c1-4f5f-887e-31668f8496fe admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.tiny", "swap": 0}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:05.778620 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-e9482a3b-c7c1-4f5f-887e-31668f8496fe admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.591411 Sep 25 00:53:05.779454 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 12/22] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:53:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 00:53:05.794918 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-d2a76ff0-03d5-497b-a1a4-8cf2dbec3945 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:05.800710 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=24,nova_api:INSERT=5,nova_api:SAVEPOINT=2,nova_api:RELEASE=2 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:05.841941 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-d2a76ff0-03d5-497b-a1a4-8cf2dbec3945 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.051085 Sep 25 00:53:05.843471 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 11/23] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Sep 25 00:53:05 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:53:09.007863 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e9482a3b-c7c1-4f5f-887e-31668f8496fe admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:09.009826 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-e9482a3b-c7c1-4f5f-887e-31668f8496fe admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002805 Sep 25 00:53:09.010904 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 13/24] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:53:09 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:09.734719 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4a83622f-aab1-4661-986d-21049decfcbb admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "rxtx_factor": 1.0, "disk": 20, "id": "2", "ram": 2048}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:09.761449 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4a83622f-aab1-4661-986d-21049decfcbb admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.742556 Sep 25 00:53:09.762697 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 12/25] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:53:09 2022] POST /compute/v2.1/flavors => generated 405 bytes in 745 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:53:09.784703 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-a2d97659-1992-4000-8870-5d1351a6ea95 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:09.829307 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-a2d97659-1992-4000-8870-5d1351a6ea95 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052428 Sep 25 00:53:09.830761 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 14/26] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Sep 25 00:53:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:53:13.129680 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4a83622f-aab1-4661-986d-21049decfcbb admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:13.131552 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4a83622f-aab1-4661-986d-21049decfcbb admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002301 Sep 25 00:53:13.135849 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 13/27] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:53:13 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:13.741834 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-a728f4ba-72df-4960-8f3e-7f126cf788af admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 4096, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "disk": 40, "vcpus": 2, "os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:13.769297 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-a728f4ba-72df-4960-8f3e-7f126cf788af admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.630335 Sep 25 00:53:13.776676 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 15/28] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:53:13 2022] POST /compute/v2.1/flavors => generated 406 bytes in 638 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 00:53:13.787916 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-57cd68fe-71ff-4a4c-a896-b077d04ebad4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:13.846319 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-57cd68fe-71ff-4a4c-a896-b077d04ebad4 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.066422 Sep 25 00:53:13.856339 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 14/29] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Sep 25 00:53:13 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 00:53:17.138362 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-a728f4ba-72df-4960-8f3e-7f126cf788af admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:17.140835 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-a728f4ba-72df-4960-8f3e-7f126cf788af admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002775 Sep 25 00:53:17.141450 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 16/30] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:53:17 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:17.806165 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-3ed7da53-0871-40c2-b9d3-5823aa246aac admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 8192, "swap": 0, "name": "m1.large", "disk": 80, "id": "4", "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:17.832865 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-3ed7da53-0871-40c2-b9d3-5823aa246aac admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.680332 Sep 25 00:53:17.833943 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 15/31] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:53:17 2022] POST /compute/v2.1/flavors => generated 405 bytes in 683 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:53:17.855998 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-43dc6123-ebcf-411e-8dbe-f0ab9383ab62 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:17.866819 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_api:SELECT=39,nova_api:SAVEPOINT=4,nova_api:INSERT=8,nova_api:RELEASE=4 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:17.901489 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-43dc6123-ebcf-411e-8dbe-f0ab9383ab62 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.052628 Sep 25 00:53:17.902494 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 17/32] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Sep 25 00:53:17 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:53:20.931221 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-3ed7da53-0871-40c2-b9d3-5823aa246aac admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:20.932127 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-3ed7da53-0871-40c2-b9d3-5823aa246aac admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 25 00:53:20.938445 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 16/33] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:53:20 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 00:53:21.486997 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-2b3f8e4b-8786-423e-8533-d3e6d5f6899c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 16384, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "id": "5", "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:21.508970 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-2b3f8e4b-8786-423e-8533-d3e6d5f6899c admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.568738 Sep 25 00:53:21.509741 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 18/34] 10.222.0.26 () {64 vars in 1283 bytes} [Sun Sep 25 00:53:20 2022] POST /compute/v2.1/flavors => generated 408 bytes in 570 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 00:53:21.523036 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-fa6803e3-6cd4-4f7a-93e0-303c78b4003f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:21.555874 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-fa6803e3-6cd4-4f7a-93e0-303c78b4003f admin admin] 10.222.0.26 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.036464 Sep 25 00:53:21.565426 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 17/35] 10.222.0.26 () {64 vars in 1333 bytes} [Sun Sep 25 00:53:21 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:53:37.081782 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-2b3f8e4b-8786-423e-8533-d3e6d5f6899c admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.082908 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-2b3f8e4b-8786-423e-8533-d3e6d5f6899c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001574 Sep 25 00:53:37.083260 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 19/36] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:37.094426 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=23,nova_api:SAVEPOINT=3,nova_api:INSERT=5,nova_api:RELEASE=3 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:37.526902 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4a718d6b-505d-45f8-9076-e8a2cca20123 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:37.546666 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4a718d6b-505d-45f8-9076-e8a2cca20123 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.456758 Sep 25 00:53:37.547225 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 18/37] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Sep 25 00:53:37 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:38.932347 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-2b3f8e4b-8786-423e-8533-d3e6d5f6899c admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:38.933421 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-2b3f8e4b-8786-423e-8533-d3e6d5f6899c admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001504 Sep 25 00:53:38.933833 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 20/38] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:39.508323 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-6b3ecd10-1b05-477e-82b9-7d89edc84cdc admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:39.514455 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.wsgi [None req-6b3ecd10-1b05-477e-82b9-7d89edc84cdc admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-6b3ecd10-1b05-477e-82b9-7d89edc84cdc admin admin] Request method failure captured: Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: Accept: application/json Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: Accept-Encoding: gzip, deflate Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: Connection: keep-alive Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: Content-Length: 0 Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: Host: 10.222.0.26 Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: Openstack-Api-Version: compute 2.92 Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: Openstack-System-Scope: None Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: User-Agent: python-novaclient Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Auth-Token: gAAAAABjL6aSrw5WcxUxrrecUH2XPnpMVVhboZyMZCwdqGmQEUVGPXRsTWBTaC7pAc-YYMXG05G-rNr-4lQrfucvutyfFoPTlcwm3eZM57Aioi4ys8klMKtIpNrVtNyMqsxvUWga5tS7qmhoGOSdCdHHNosjv45ytCfe3mYZ14JROzvMc8eQ4No Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Domain-Id: None Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Domain-Name: None Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Identity-Status: Confirmed Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Is-Admin-Project: True Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Domain-Id: default Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Domain-Name: Default Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Name: admin Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Role: admin,reader,member Sep 25 00:53:39.517736 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Roles: admin,reader,member Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3708ba2402cc4ee7abd81255a285d2b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}] Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant: admin Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant-Name: admin Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User: admin Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Domain-Id: default Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Domain-Name: Default Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Id: 7935e75bd19b46fd9203b785ff55ae84 Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Name: admin Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: method: > Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: exception: Flavor 42 could not be found. Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: action_args: {'id': '42'} Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:53:39.520616 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:39.522519 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.525162 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-6b3ecd10-1b05-477e-82b9-7d89edc84cdc admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:53:39.527921 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-6b3ecd10-1b05-477e-82b9-7d89edc84cdc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.445281 Sep 25 00:53:39.527921 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 19/39] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Sep 25 00:53:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 447 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:39.533136 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-c31610cc-67a2-4b21-967a-85052ade4b71 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:39.537311 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:INSERT=2,nova_api:RELEASE=1 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:53:39.556427 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-c31610cc-67a2-4b21-967a-85052ade4b71 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027348 Sep 25 00:53:39.556964 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 21/40] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Sep 25 00:53:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:39.569025 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-2313468a-b586-4298-aeb0-2bf87fe22056 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:39.592054 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-2313468a-b586-4298-aeb0-2bf87fe22056 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.027498 Sep 25 00:53:39.592663 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 20/41] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Sep 25 00:53:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:39.602858 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e6e45cfb-4436-4f1b-b6be-62f52d208a27 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:39.608754 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.wsgi [None req-e6e45cfb-4436-4f1b-b6be-62f52d208a27 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e6e45cfb-4436-4f1b-b6be-62f52d208a27 admin admin] Request method failure captured: Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: Accept: application/json Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: Accept-Encoding: gzip, deflate Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: Connection: keep-alive Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: Content-Length: 0 Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: Host: 10.222.0.26 Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: Openstack-Api-Version: compute 2.92 Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: Openstack-System-Scope: None Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: User-Agent: python-novaclient Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Auth-Token: gAAAAABjL6aSrw5WcxUxrrecUH2XPnpMVVhboZyMZCwdqGmQEUVGPXRsTWBTaC7pAc-YYMXG05G-rNr-4lQrfucvutyfFoPTlcwm3eZM57Aioi4ys8klMKtIpNrVtNyMqsxvUWga5tS7qmhoGOSdCdHHNosjv45ytCfe3mYZ14JROzvMc8eQ4No Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Domain-Id: None Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Domain-Name: None Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Identity-Status: Confirmed Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Is-Admin-Project: True Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Domain-Id: default Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Domain-Name: Default Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Name: admin Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Role: admin,reader,member Sep 25 00:53:39.612117 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Roles: admin,reader,member Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3708ba2402cc4ee7abd81255a285d2b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}] Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant: admin Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant-Name: admin Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User: admin Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Domain-Id: default Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Domain-Name: Default Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Id: 7935e75bd19b46fd9203b785ff55ae84 Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Name: admin Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: method: > Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: exception: Flavor 42 could not be found. Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: action_args: {'id': '42'} Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:53:39.613732 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:39.614704 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:39.615762 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e6e45cfb-4436-4f1b-b6be-62f52d208a27 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:53:39.616839 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-e6e45cfb-4436-4f1b-b6be-62f52d208a27 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014973 Sep 25 00:53:39.616839 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 22/42] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Sep 25 00:53:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:40.927600 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-2313468a-b586-4298-aeb0-2bf87fe22056 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:40.928637 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-2313468a-b586-4298-aeb0-2bf87fe22056 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 25 00:53:40.929168 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 21/43] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:41.492295 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-028a1b13-82ef-4412-aa4d-5357e19c204e admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:41.498494 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.wsgi [None req-028a1b13-82ef-4412-aa4d-5357e19c204e admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-028a1b13-82ef-4412-aa4d-5357e19c204e admin admin] Request method failure captured: Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: Accept: application/json Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: Accept-Encoding: gzip, deflate Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: Connection: keep-alive Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: Content-Length: 0 Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: Host: 10.222.0.26 Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: Openstack-Api-Version: compute 2.92 Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: Openstack-System-Scope: None Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: User-Agent: python-novaclient Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Auth-Token: gAAAAABjL6aUZxngxI4YZw5HwXdY72XjpkECaxYlhkOAfQyHPYVkzYX_WvvJTKh1hIr-2XnxWOcASXRw_oA8LN7_7ZaTLMF9ZW8DyvDkkmQQGrfvc7vtsC9HE4wYOY7PeNCLzxd0esLaI0MUH3Pu4DwgSO4d_5L1XhaOpXH0UHZziHZXsvBO3FI Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Domain-Id: None Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Domain-Name: None Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Identity-Status: Confirmed Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Is-Admin-Project: True Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Domain-Id: default Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Domain-Name: Default Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Name: admin Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Role: admin,reader,member Sep 25 00:53:41.500059 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Roles: admin,reader,member Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3708ba2402cc4ee7abd81255a285d2b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}] Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant: admin Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant-Name: admin Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User: admin Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Domain-Id: default Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Domain-Name: Default Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Id: 7935e75bd19b46fd9203b785ff55ae84 Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Name: admin Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: method: > Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: exception: Flavor 84 could not be found. Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: action_args: {'id': '84'} Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:53:41.502955 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:41.504867 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.507393 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-028a1b13-82ef-4412-aa4d-5357e19c204e admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:53:41.509490 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-028a1b13-82ef-4412-aa4d-5357e19c204e admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.432236 Sep 25 00:53:41.509490 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 23/44] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Sep 25 00:53:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 434 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:41.512766 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4735f9c8-84bf-4868-85f9-aa14956997dc admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:41.529386 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4735f9c8-84bf-4868-85f9-aa14956997dc admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020997 Sep 25 00:53:41.529967 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 22/45] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Sep 25 00:53:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 00:53:41.540016 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-14caf47b-2692-451c-b6d8-02f00803ee56 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:41.556174 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-14caf47b-2692-451c-b6d8-02f00803ee56 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019720 Sep 25 00:53:41.556764 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 24/46] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Sep 25 00:53:41 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:41.567026 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-0fbe5137-077f-4d4e-af9e-5f98c66a516c admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:41.572819 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.wsgi [None req-0fbe5137-077f-4d4e-af9e-5f98c66a516c admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-0fbe5137-077f-4d4e-af9e-5f98c66a516c admin admin] Request method failure captured: Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: Accept: application/json Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: Accept-Encoding: gzip, deflate Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: Connection: keep-alive Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: Content-Length: 0 Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: Host: 10.222.0.26 Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: Openstack-Api-Version: compute 2.92 Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: Openstack-System-Scope: None Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: User-Agent: python-novaclient Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Auth-Token: gAAAAABjL6aUZxngxI4YZw5HwXdY72XjpkECaxYlhkOAfQyHPYVkzYX_WvvJTKh1hIr-2XnxWOcASXRw_oA8LN7_7ZaTLMF9ZW8DyvDkkmQQGrfvc7vtsC9HE4wYOY7PeNCLzxd0esLaI0MUH3Pu4DwgSO4d_5L1XhaOpXH0UHZziHZXsvBO3FI Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Domain-Id: None Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Domain-Name: None Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Identity-Status: Confirmed Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Is-Admin-Project: True Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Domain-Id: default Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Domain-Name: Default Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Name: admin Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Role: admin,reader,member Sep 25 00:53:41.574370 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Roles: admin,reader,member Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3708ba2402cc4ee7abd81255a285d2b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}] Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant: admin Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant-Name: admin Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User: admin Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Domain-Id: default Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Domain-Name: Default Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Id: 7935e75bd19b46fd9203b785ff55ae84 Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Name: admin Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: method: > Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: exception: Flavor 84 could not be found. Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: action_args: {'id': '84'} Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:53:41.575934 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:41.576924 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:41.578222 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-0fbe5137-077f-4d4e-af9e-5f98c66a516c admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:53:41.579514 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-0fbe5137-077f-4d4e-af9e-5f98c66a516c admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.012404 Sep 25 00:53:41.579514 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 23/47] 10.222.0.26 () {60 vars in 1190 bytes} [Sun Sep 25 00:53:41 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:42.945944 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-14caf47b-2692-451c-b6d8-02f00803ee56 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:42.946979 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-14caf47b-2692-451c-b6d8-02f00803ee56 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 25 00:53:42.947397 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 25/48] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:43.506074 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-77329012-5118-45b3-b8c2-17f9beecd161 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:43.512071 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.wsgi [None req-77329012-5118-45b3-b8c2-17f9beecd161 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-77329012-5118-45b3-b8c2-17f9beecd161 admin admin] Request method failure captured: Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: Accept: application/json Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: Accept-Encoding: gzip, deflate Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: Connection: keep-alive Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: Content-Length: 0 Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: Host: 10.222.0.26 Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: Openstack-Api-Version: compute 2.92 Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: Openstack-System-Scope: None Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: User-Agent: python-novaclient Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Auth-Token: gAAAAABjL6aWV7CPrQLLWm9JvngIHmvCyExa-EMQ67Zg6aaCy4APXgjNZ9xNK_U7Xp8bg1QPDO8lhH42RkNEmbNMVmWxwpWwIHHo108WzdOT2ynapkhLptI6fogcf1hghs3oGyfV_QZfumg4815beo1_4-8HLshATqVQMN2eSW9EzGYeVgKKkJk Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Domain-Id: None Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Domain-Name: None Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Identity-Status: Confirmed Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Is-Admin-Project: True Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Domain-Id: default Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Domain-Name: Default Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Project-Name: admin Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Role: admin,reader,member Sep 25 00:53:43.513808 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Roles: admin,reader,member Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3708ba2402cc4ee7abd81255a285d2b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}] Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant: admin Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-Tenant-Name: admin Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User: admin Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Domain-Id: default Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Domain-Name: Default Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Id: 7935e75bd19b46fd9203b785ff55ae84 Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: X-User-Name: admin Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: method: > Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: exception: Flavor 451 could not be found. Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: action_args: {'id': '451'} Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:53:43.515402 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:43.516604 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.518079 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-77329012-5118-45b3-b8c2-17f9beecd161 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105627) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:53:43.519267 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-77329012-5118-45b3-b8c2-17f9beecd161 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.430262 Sep 25 00:53:43.519267 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 24/49] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Sep 25 00:53:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 431 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 25 00:53:43.525618 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-1ff6e41d-685b-4712-aed0-4279a47f68d0 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:43.541304 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-1ff6e41d-685b-4712-aed0-4279a47f68d0 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019378 Sep 25 00:53:43.541874 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 26/50] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Sep 25 00:53:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:43.552446 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:43.569308 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.020416 Sep 25 00:53:43.569880 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 25/51] 10.222.0.26 () {60 vars in 1210 bytes} [Sun Sep 25 00:53:43 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 22 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:53:43.579692 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e1544fa1-4e8b-468e-a08c-80219c640cae admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:43.585329 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.wsgi [None req-e1544fa1-4e8b-468e-a08c-80219c640cae admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e1544fa1-4e8b-468e-a08c-80219c640cae admin admin] Request method failure captured: Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: Accept: application/json Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: Accept-Encoding: gzip, deflate Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: Connection: keep-alive Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: Content-Length: 0 Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: Host: 10.222.0.26 Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: Openstack-Api-Version: compute 2.92 Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: Openstack-System-Scope: None Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: User-Agent: python-novaclient Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Auth-Token: gAAAAABjL6aWV7CPrQLLWm9JvngIHmvCyExa-EMQ67Zg6aaCy4APXgjNZ9xNK_U7Xp8bg1QPDO8lhH42RkNEmbNMVmWxwpWwIHHo108WzdOT2ynapkhLptI6fogcf1hghs3oGyfV_QZfumg4815beo1_4-8HLshATqVQMN2eSW9EzGYeVgKKkJk Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Domain-Id: None Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Domain-Name: None Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Identity-Status: Confirmed Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Is-Admin-Project: True Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Openstack-Nova-Api-Version: 2.92 Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Domain-Id: default Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Domain-Name: Default Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Project-Name: admin Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Role: admin,reader,member Sep 25 00:53:43.586875 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Roles: admin,reader,member Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_3708ba2402cc4ee7abd81255a285d2b9", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/3708ba2402cc4ee7abd81255a285d2b9"}]}] Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant: admin Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant-Id: 3708ba2402cc4ee7abd81255a285d2b9 Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-Tenant-Name: admin Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User: admin Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Domain-Id: default Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Domain-Name: Default Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Id: 7935e75bd19b46fd9203b785ff55ae84 Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: X-User-Name: admin Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: method: > Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: exception: Flavor 451 could not be found. Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: action_args: {'id': '451'} Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 00:53:43.588357 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:43.589284 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: ERROR nova.api.openstack.wsgi Sep 25 00:53:43.590515 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e1544fa1-4e8b-468e-a08c-80219c640cae admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105628) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 00:53:43.592425 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-e1544fa1-4e8b-468e-a08c-80219c640cae admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012347 Sep 25 00:53:43.592425 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 27/52] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Sep 25 00:53:43 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 25 00:53:44.861592 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:44.862664 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 25 00:53:44.863067 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 26/53] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:45.442147 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-493506f2-ab5c-413b-bd13-1f4bb3178d2e admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:45.465297 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-493506f2-ab5c-413b-bd13-1f4bb3178d2e admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.462643 Sep 25 00:53:45.465863 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 28/54] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Sep 25 00:53:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 464 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:53:46.792398 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:46.793428 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001498 Sep 25 00:53:46.793841 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 27/55] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:47.352549 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-b5a2820c-feb8-4b8e-83db-19de5ca2428a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:47.373368 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-b5a2820c-feb8-4b8e-83db-19de5ca2428a admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.434269 Sep 25 00:53:47.373937 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 29/56] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Sep 25 00:53:46 2022] POST /compute/v2.1/flavors => generated 405 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:53:48.683840 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:48.685728 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002621 Sep 25 00:53:48.686453 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 28/57] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:48 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:49.360254 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-8393c443-b097-483c-a678-099bab919b12 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:49.381059 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-8393c443-b097-483c-a678-099bab919b12 admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.502910 Sep 25 00:53:49.381617 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 30/58] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Sep 25 00:53:48 2022] POST /compute/v2.1/flavors => generated 407 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:53:50.650420 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:50.651570 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 25 00:53:50.651899 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 29/59] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:53:51.226961 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-73939a24-69dc-4047-bdaa-2b17a523bfcc admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 00:53:51.249654 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-73939a24-69dc-4047-bdaa-2b17a523bfcc admin admin] 10.222.0.26 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.460060 Sep 25 00:53:51.250213 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 31/60] 10.222.0.26 () {64 vars in 1235 bytes} [Sun Sep 25 00:53:50 2022] POST /compute/v2.1/flavors => generated 409 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:53:52.565611 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:52.566581 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001506 Sep 25 00:53:52.567028 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 30/61] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:53:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 00:53:53.139246 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-1185bdf9-a20a-40c3-8337-0126f19c28cb admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:53:53.165881 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-1185bdf9-a20a-40c3-8337-0126f19c28cb admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.459937 Sep 25 00:53:53.166426 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 32/62] 10.222.0.26 () {60 vars in 1202 bytes} [Sun Sep 25 00:53:52 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 00:54:53.586407 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:54:53.587885 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-4865f379-2866-4908-9c8d-909c21940598 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001964 Sep 25 00:54:53.588446 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 31/63] 10.222.0.26 () {54 vars in 931 bytes} [Sun Sep 25 00:54:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:54:53.596695 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:54.072764 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-b1fe8989-fe17-475c-8091-cc7d64991b13 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:54:54.094967 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-b1fe8989-fe17-475c-8091-cc7d64991b13 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.499636 Sep 25 00:54:54.095543 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 33/64] 10.222.0.26 () {60 vars in 1292 bytes} [Sun Sep 25 00:54:53 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:54:54.116743 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=14 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:54:54.121213 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-0af4c854-c70d-4381-8e29-4806fc5de917 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:54:54.128857 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-0af4c854-c70d-4381-8e29-4806fc5de917 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013593 Sep 25 00:54:54.129435 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 32/65] 10.222.0.26 () {60 vars in 1283 bytes} [Sun Sep 25 00:54:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:54:54.142447 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-abae93f2-d50f-4424-b701-b29718126524 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:54:54.150320 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-abae93f2-d50f-4424-b701-b29718126524 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011615 Sep 25 00:54:54.150889 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 34/66] 10.222.0.26 () {60 vars in 1286 bytes} [Sun Sep 25 00:54:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:54:54.163411 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:54:54.172309 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012782 Sep 25 00:54:54.172925 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 33/67] 10.222.0.26 () {60 vars in 1286 bytes} [Sun Sep 25 00:54:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:54:54.185711 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-ef65461f-926e-4d28-9e51-77edae053aed admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:54:54.193247 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-ef65461f-926e-4d28-9e51-77edae053aed admin admin] 10.222.0.26 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011858 Sep 25 00:54:54.193816 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 35/68] 10.222.0.26 () {60 vars in 1283 bytes} [Sun Sep 25 00:54:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 00:58:05.590064 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:05.591214 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002185 Sep 25 00:58:05.591625 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 34/69] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:58:05.738463 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_api:SELECT=6 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:05.893400 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:05.898216 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:05.898689 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:05.899983 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:05.900778 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:05.901274 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:05.901691 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:05.934934 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-55e211b6-d870-4923-9c56-42dd828f1be2 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.197583 Sep 25 00:58:05.935518 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 36/70] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Sep 25 00:58:05 2022] GET /compute/v2.1/os-services => generated 785 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 00:58:07.085800 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:07.087075 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Sep 25 00:58:07.087488 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 35/71] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:58:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:58:07.282061 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:07.285490 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:07.285967 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:07.286393 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:07.287109 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:07.287545 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:07.287959 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:07.308285 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-e76a6648-8707-4b8c-96d9-fa3c7cb4cd86 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 785 microversion: 2.92 time: 0.077932 Sep 25 00:58:07.308895 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 37/72] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Sep 25 00:58:07 2022] GET /compute/v2.1/os-services => generated 785 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 00:58:18.934174 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:18.935220 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001491 Sep 25 00:58:18.935629 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 36/73] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:58:19.088053 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_cell0:SELECT=4 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:19.088872 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_cell1:SELECT=4 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:19.089526 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG dbcounter [-] [105628] Writing DB stats nova_api:SELECT=8 {{(pid=105628) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:58:19.141087 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:19.144520 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:19.145938 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:19.146385 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:19.147128 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:19.147580 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:19.147999 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:19.192219 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-98de3cc0-5aa3-4487-b536-03498dd2f979 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.108743 Sep 25 00:58:19.192827 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 38/74] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Sep 25 00:58:19 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:58:20.323239 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG nova.api.openstack.wsgi [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] Calling method '>' {{(pid=105627) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:20.324357 dv-cinder-master-3-smb devstack@n-api.service[105627]: INFO nova.api.openstack.requestlog [None req-c112a974-8f5e-45a0-b511-464d3aea3b07 admin admin] 10.222.0.26 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001672 Sep 25 00:58:20.324823 dv-cinder-master-3-smb devstack@n-api.service[105627]: [pid: 105627|app: 0|req: 37/75] 10.222.0.26 () {56 vars in 1074 bytes} [Sun Sep 25 00:58:20 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 00:58:20.517708 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG nova.api.openstack.wsgi [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] Calling method '>' {{(pid=105628) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 00:58:20.521241 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:20.521695 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:20.522127 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:20.522912 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:58:20.523381 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:58:20.523738 dv-cinder-master-3-smb devstack@n-api.service[105628]: DEBUG oslo_concurrency.lockutils [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105628) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:58:20.547392 dv-cinder-master-3-smb devstack@n-api.service[105628]: INFO nova.api.openstack.requestlog [None req-27b432a8-9a41-4adc-8c75-c3aab17e0ee7 admin admin] 10.222.0.26 "GET /compute/v2.1/os-services" status: 200 len: 1005 microversion: 2.92 time: 0.082192 Sep 25 00:58:20.548022 dv-cinder-master-3-smb devstack@n-api.service[105628]: [pid: 105628|app: 0|req: 39/76] 10.222.0.26 () {60 vars in 1193 bytes} [Sun Sep 25 00:58:20 2022] GET /compute/v2.1/os-services => generated 1005 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 00:59:32.265067 dv-cinder-master-3-smb systemd[1]: Stopping Devstack devstack@n-api.service... Sep 25 00:59:32.266665 dv-cinder-master-3-smb devstack@n-api.service[105614]: Sun Sep 25 00:59:32 2022 - graceful shutdown triggered... Sep 25 00:59:32.267442 dv-cinder-master-3-smb devstack@n-api.service[105627]: Gracefully killing worker 1 (pid: 105627)... Sep 25 00:59:32.268156 dv-cinder-master-3-smb devstack@n-api.service[105628]: Gracefully killing worker 2 (pid: 105628)... Sep 25 00:59:32.442470 dv-cinder-master-3-smb devstack@n-api.service[105627]: DEBUG dbcounter [-] [105627] Writing DB stats nova_api:SELECT=4 {{(pid=105627) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 00:59:33.267049 dv-cinder-master-3-smb devstack@n-api.service[105614]: worker 1 buried after 1 seconds Sep 25 00:59:33.267049 dv-cinder-master-3-smb devstack@n-api.service[105614]: worker 2 buried after 1 seconds Sep 25 00:59:33.267049 dv-cinder-master-3-smb devstack@n-api.service[105614]: goodbye to uWSGI. Sep 25 00:59:33.268871 dv-cinder-master-3-smb systemd[1]: devstack@n-api.service: Succeeded. Sep 25 00:59:33.269460 dv-cinder-master-3-smb systemd[1]: Stopped Devstack devstack@n-api.service. Sep 25 00:59:33.272927 dv-cinder-master-3-smb systemd[1]: Starting Devstack devstack@n-api.service... Sep 25 00:59:33.286188 dv-cinder-master-3-smb devstack@n-api.service[120906]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 25 00:59:33.290587 dv-cinder-master-3-smb devstack@n-api.service[120906]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Sep 25 00:59:33 2022] *** Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: nodename: dv-cinder-master-3-smb Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: machine: x86_64 Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: clock source: unix Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: pcre jit disabled Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: detected number of CPU cores: 4 Sep 25 00:59:33.290901 dv-cinder-master-3-smb devstack@n-api.service[120906]: current working directory: / Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: detected binary path: /usr/bin/uwsgi-core Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: your processes number limit is 47680 Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: your memory page size is 4096 bytes Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: detected max file descriptor number: 2048 Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: lock engine: pthread robust mutexes Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: thunder lock: enabled Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 25 00:59:33.291872 dv-cinder-master-3-smb devstack@n-api.service[120906]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 25 00:59:33.351057 dv-cinder-master-3-smb devstack@n-api.service[120906]: Python main interpreter initialized at 0x55b91b06f9c0 Sep 25 00:59:33.351057 dv-cinder-master-3-smb devstack@n-api.service[120906]: python threads support enabled Sep 25 00:59:33.351057 dv-cinder-master-3-smb devstack@n-api.service[120906]: your server socket listen backlog is limited to 100 connections Sep 25 00:59:33.351057 dv-cinder-master-3-smb devstack@n-api.service[120906]: your mercy for graceful operations on workers is 90 seconds Sep 25 00:59:33.351636 dv-cinder-master-3-smb devstack@n-api.service[120906]: mapped 403077 bytes (393 KB) for 2 cores Sep 25 00:59:33.351766 dv-cinder-master-3-smb devstack@n-api.service[120906]: *** Operational MODE: preforking *** Sep 25 00:59:33.352198 dv-cinder-master-3-smb devstack@n-api.service[120906]: *** uWSGI is running in multiple interpreter mode *** Sep 25 00:59:33.352198 dv-cinder-master-3-smb devstack@n-api.service[120906]: spawned uWSGI master process (pid: 120906) Sep 25 00:59:33.352527 dv-cinder-master-3-smb systemd[1]: Started Devstack devstack@n-api.service. Sep 25 00:59:33.353428 dv-cinder-master-3-smb devstack@n-api.service[120906]: spawned uWSGI worker 1 (pid: 120931, cores: 1) Sep 25 00:59:33.353968 dv-cinder-master-3-smb devstack@n-api.service[120906]: spawned uWSGI worker 2 (pid: 120932, cores: 1) Sep 25 00:59:33.354204 dv-cinder-master-3-smb devstack@n-api.service[120906]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 25 00:59:34.166896 dv-cinder-master-3-smb devstack@n-api.service[120932]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:59:34.247772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 25 00:59:35.728655 dv-cinder-master-3-smb devstack@n-api.service[120932]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:35.728655 dv-cinder-master-3-smb devstack@n-api.service[120932]: from cryptography.utils import int_from_bytes Sep 25 00:59:35.731141 dv-cinder-master-3-smb devstack@n-api.service[120932]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:35.731141 dv-cinder-master-3-smb devstack@n-api.service[120932]: from cryptography.utils import int_from_bytes Sep 25 00:59:35.838711 dv-cinder-master-3-smb devstack@n-api.service[120931]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:35.838711 dv-cinder-master-3-smb devstack@n-api.service[120931]: from cryptography.utils import int_from_bytes Sep 25 00:59:35.839708 dv-cinder-master-3-smb devstack@n-api.service[120931]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 25 00:59:35.839708 dv-cinder-master-3-smb devstack@n-api.service[120931]: from cryptography.utils import int_from_bytes Sep 25 00:59:38.756507 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:59:38.757303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:59:38.757303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:59:38.757853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:59:38.758016 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:59:38.758345 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.758688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.759049 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.759366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.759715 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.760051 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.760366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.760724 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.761065 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.761335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.761661 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.762169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.762504 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.762824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.763148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.763484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.763801 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.764130 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.764475 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.765006 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.765781 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.766111 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.766570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.766890 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.767205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.767531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.767912 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.768272 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.768683 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.769021 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.769362 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.769761 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.770104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.770410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.770755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.771163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.771549 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.771549 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.772244 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.772244 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.772986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.772986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.773998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.773998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.773998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.774698 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.774698 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.774698 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.775500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.775500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.775986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.775986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.776863 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.776863 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.777348 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.777348 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.777780 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.779187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.779187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.779187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.779187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.779187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.780284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.780284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.780284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.780991 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.780991 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.780991 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.782429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.782429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.782429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.782429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.783324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.783324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.783324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.784027 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.784027 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.784925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.784925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.785427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.785427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.785884 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.785884 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.786536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.786536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.787006 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.787250 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.787500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.787731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.787975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.789406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.789406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.789950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.789950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.790399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.790399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.790844 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.791074 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.791296 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.792184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.792184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.792673 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.793029 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.793263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.793612 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.794057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.794352 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.794668 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.795114 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.795474 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.795814 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.796135 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.796621 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.796914 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.797238 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.797554 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.797881 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.798278 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.799146 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.799146 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.799603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.799824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.800045 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.800267 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.800615 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.800932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.801247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.801561 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.802310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.802310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.802752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.803144 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.803144 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.803750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.803970 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.804210 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.805126 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.805548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:38.805814 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.806040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.806412 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.806852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.807203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.807531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.807917 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.808243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.808678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.809399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.809399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.809864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.810129 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.810367 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.810666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.811049 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.811382 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.811711 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.812311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.812845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.812845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.814473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.814473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.814473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.814473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.815891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.815891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.815891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.815891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.816843 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.816843 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.816843 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.817653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.817653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.818113 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.818113 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.818576 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.818817 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.819555 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.819555 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.820692 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.820941 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.821168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.821424 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.821870 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.822208 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.823180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.823180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.823180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.823864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.823864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.824286 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.824802 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.825031 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.825347 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.825845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.826266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.826530 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.826886 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.827395 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.827665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.827985 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.828310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.828663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.829090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.829988 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.829988 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.830451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.830451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.831203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.831203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.831670 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.831670 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.832084 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.832324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.833425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.833425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.833425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.834106 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.834106 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.834539 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.834539 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.835205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.835432 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.836394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.836763 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.837105 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.837546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.837889 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.838211 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.838561 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.839026 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.839445 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.839840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.840562 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.841158 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.841755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.842355 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.842939 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.843538 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.844188 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.844851 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.845448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.846052 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.846645 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.847335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.847933 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.848640 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.849303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.849921 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.850559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.851151 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.852034 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.852370 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.852735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.853177 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.853591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.854125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.854368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.854716 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.855069 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.856243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.856243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.856243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.856877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.856877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.857305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.857966 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.858610 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.859276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.859906 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.860578 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.861214 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.863522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.863522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.863522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.864362 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.866085 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.866797 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.868013 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.868528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.868885 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.869310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.869734 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.870187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.870587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.871014 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.871435 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.871831 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.872318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.872705 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.873044 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.873409 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.873931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.874212 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.874621 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.875073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.875494 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.875984 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.876560 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.877125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.877528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.878096 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.878578 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.879051 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.879706 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.880318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.881028 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.881681 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.882298 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.882960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.883632 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.884254 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.884927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.885548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.886175 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.886874 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.887230 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.887639 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.887985 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.888553 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.888970 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.889376 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.889681 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.890101 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.890459 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.890822 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.891228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.891718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.891983 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.892314 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.892676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.893023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.893349 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.893677 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.894003 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.894325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.894650 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.895084 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.895767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.896121 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.896476 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.896811 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.897175 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.897554 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.897934 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.898317 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.898645 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.899121 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.899462 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.899787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.900149 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.900548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.900873 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.901235 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.901871 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.902267 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.902590 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.902931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.903249 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.903566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.903895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.904212 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.904572 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.904892 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.905331 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.905742 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.906147 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.906468 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.906792 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.907171 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.907490 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.907952 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.908297 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.908711 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.909031 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.909460 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.909803 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.910121 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.910530 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.910857 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.911174 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.911582 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.911904 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.912325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.912679 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.913005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.913327 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.913641 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.914488 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.914845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.915215 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.915611 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.915942 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.916336 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.916707 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.917030 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.917347 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.917669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.917997 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.918322 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.918644 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.918955 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.919267 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.919597 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.919924 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.920253 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.920609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.920931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.921252 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.921570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.921909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.922194 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.922509 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.922905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.923154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.923546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.923823 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.924188 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.924501 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.924813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.925273 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.925598 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.925866 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.926160 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.926472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.926796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.927104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.927450 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.927770 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.928097 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.928430 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.928750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.929111 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.929489 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.929868 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.930180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.930508 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.930845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.931280 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.931488 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.931816 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.932127 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.932480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.932808 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.933131 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.933448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.933769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.934110 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.934427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.934841 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.935082 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.935420 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.935852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.936172 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.936601 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.936927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.937253 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.937575 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.937893 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.938228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.938547 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.938916 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.939185 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.939510 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.939829 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.940148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.940501 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.940823 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.941163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.941484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.941799 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.942120 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.942439 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.942760 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.943074 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.943525 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.943849 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.944167 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.944508 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.944829 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.945833 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.946201 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.946582 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.946957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.947413 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.947739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.948063 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.948456 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.948743 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.949058 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.949381 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.949726 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.950045 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.950361 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.950673 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.951012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.951324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.951749 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.952206 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.952566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.952884 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.953415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.953739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.954064 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.954401 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.954733 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.955070 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.955388 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.955728 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.956148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.956534 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.956950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.957311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.957616 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.957957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.958293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.958718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.959077 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.959481 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.959982 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.960354 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.960800 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.961141 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.961568 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.961927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.962259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.962612 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.962931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.963246 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.963590 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.963909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.964234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.964608 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.964931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.965247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.965561 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.965897 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.966291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.966719 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.967210 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.967589 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.967925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.968244 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.968611 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.969026 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.969349 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.969666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.969990 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.970350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.970745 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.971087 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.971480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.971993 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.972440 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.972793 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.973139 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.973495 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.973790 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.974121 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.974459 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.974773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.975088 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.975409 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.975728 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.976046 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.977011 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.977419 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.977734 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.978048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.978364 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.978701 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.979109 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.979458 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.979779 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.980102 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.980442 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.980762 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.981125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.981438 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.981880 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.982205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.982573 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.982946 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.983274 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.983608 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.983933 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.984259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.984616 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.984940 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.985355 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.985685 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.986012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.986369 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.986959 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.987504 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.987836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.988164 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.988521 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.988853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.989268 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.989597 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.989928 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.990250 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.990570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.990922 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.991254 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.991594 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.992660 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.993095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.993428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.993760 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.994087 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.994469 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.994795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.995116 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.995469 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.995865 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.996195 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.996704 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.997270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.997746 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.998159 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.998427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.998758 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.999184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.999562 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:38.999918 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.000282 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.000648 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.000983 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.001400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.001742 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.002342 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.002870 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.003099 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.003357 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.003695 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.004027 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.004355 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.004893 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.005478 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.007028 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.009168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.009168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.009168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.009168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.009168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.009168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.010709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.010709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.010709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.010709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.011081 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.011227 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.011516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.011847 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.012270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.012534 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.013039 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.013200 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.013478 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.013807 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.014125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.014437 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.014786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.015079 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.015394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.015777 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.016032 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.016372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.016714 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.017030 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.017346 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.017667 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.017987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.018297 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.023216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.024665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.025984 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.025984 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.025984 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.026408 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.027181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.029855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.029855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.029855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.029855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.031809 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.031809 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.031809 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.031809 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.032644 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.032880 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.033340 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.033793 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.034346 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.034801 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.035269 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.046605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.047787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.048368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.048368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.048368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.048368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.048368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.048878 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.049251 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.049845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.050400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.050975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.051465 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.051882 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.052281 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.052730 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.053124 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.053545 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.053973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.054501 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.055125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.055721 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.056187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.057179 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.057688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.058134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.058562 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.058991 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.059424 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.059853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.060305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.060794 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.061230 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.061657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.062095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.062516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.062939 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.063363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.063782 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.064206 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.064669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.065095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.065514 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.065943 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.066390 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.066819 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.067366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.067823 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.068270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.068753 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.069199 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.069637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.070117 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.070570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.071042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.071485 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.071927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.072362 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.072845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.073269 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.073709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.074144 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.074576 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.075011 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.075434 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.075877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.076410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.076853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.077318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.077749 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.078216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.078649 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.079076 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.079523 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.079962 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.080438 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.080879 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.081342 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.081779 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.082217 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.082650 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.083083 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.083662 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.084234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.084682 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.085167 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.086120 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.086590 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.087034 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.087523 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.087953 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.088498 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.088942 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.089372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.089808 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.090234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.090616 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120932) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:59:39.160548 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO dbcounter [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Registered counter for database nova_api Sep 25 00:59:39.183839 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:39.191995 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:39.254270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.context [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c40cf22-5cbd-4586-b2d3-96f125e105b5(cell1) {{(pid=120932) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:59:39.260004 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:39.260446 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:39.262202 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:39.263062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:39.263569 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:39.266152 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:39.268797 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO dbcounter [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Registered counter for database nova_cell0 Sep 25 00:59:39.273790 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO dbcounter [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Registered counter for database nova_cell1 Sep 25 00:59:39.282527 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:39.285994 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:39.291280 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:39.298718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:39.466409 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 25 00:59:39.468293 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 25 00:59:39.469549 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 25 00:59:39.469946 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO dbcounter [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Registered counter for database nova_cell0 Sep 25 00:59:39.470247 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 25 00:59:39.470700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 25 00:59:39.471387 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.471993 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.472820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.473390 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.473999 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.474578 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.475176 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.475742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.476935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.477419 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.478023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.478893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-smb {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.479507 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.480092 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.480722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.481062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_db.sqlalchemy.engines [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120932) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:39.481325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.481869 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.482488 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.483043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.484051 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.484688 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.485265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.485851 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.486463 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.487046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.487209 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writer thread running {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:39.487632 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.488222 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.488852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.489438 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.489987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.490701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-smb {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.491293 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.492590 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.493143 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.493924 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.494516 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.495100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.495685 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.496302 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.498164 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.498537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.499103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.499691 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.500494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.500936 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.501527 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.502115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.502735 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.503322 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.503888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.504365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.504941 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.505560 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.506142 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.506754 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.507227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.507743 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.508347 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.509268 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.509863 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.510531 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.511036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.511628 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.512212 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.512840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.513437 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.514005 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.514928 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.515194 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.515758 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.516326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.516949 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.517705 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.26 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.518165 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.26 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.518752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.519408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.520004 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.520636 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.521269 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.521874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.522480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.523105 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.523694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.524303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.524982 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.525578 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.526057 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.526893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.527480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.528079 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.528684 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.529280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.529876 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.530450 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.530998 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.531598 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.532180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.532807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.533402 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.533999 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.534549 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.535141 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.535721 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.536300 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.536958 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.537542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.539195 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.539352 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.539815 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.540444 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.541061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.541656 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.542265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.542854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.543446 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.544057 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.544643 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.545197 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.545783 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.546393 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.548548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.549158 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.549786 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.550385 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.550962 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.551522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.552807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.552807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.553337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.554046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.554548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.555574 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.556141 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.556761 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.557310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.557859 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.558390 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.558971 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 25 00:59:39.559642 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.560178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.560788 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.561339 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.561925 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.562609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.563157 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.563729 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.564326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.564979 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.565565 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.566151 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.566726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.567325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.567921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.568639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.569203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.569892 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.570419 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.571011 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.571606 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.572223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.572862 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.573462 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.574165 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.574782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.575335 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.575937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.576569 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.577133 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.577709 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.578300 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.578934 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.579538 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.580132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.580766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.581356 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.581944 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.582540 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.583120 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.583690 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.584265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.584900 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.585542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.586172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.586789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.587385 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.587935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.588557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.589150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.589741 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.590337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.590908 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.591444 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.592003 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.592640 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.593232 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.593873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.594459 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.595046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.595678 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.596266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.596910 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.597494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.598076 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.598653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.599196 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.599700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.600256 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.600870 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.602032 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.602625 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.603230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.603803 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.604370 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.604981 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.605570 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.606133 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.606692 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.607276 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.607906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.608607 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.609112 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.609722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.610340 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.611040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.611507 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.612106 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.612747 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.613732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.613913 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.614412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.614968 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.615528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.616102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.616726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.617390 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.617964 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.618539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.619117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.619740 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.620318 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.620951 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.621524 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.622178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.622829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.623451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.624060 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.624717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.625342 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.625946 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.626538 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.627110 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.627697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.628283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.628900 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.629484 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.630096 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.630681 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.631290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.631882 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.633040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.633620 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.634235 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.634828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.635411 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.636097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.636828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.637341 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.637949 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.638554 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.639161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.639753 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.640350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.640955 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.641557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.642150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.642738 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.643354 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.643941 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.644601 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.645168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.645951 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.646306 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.646901 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.647519 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.648837 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.649782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.650377 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.651007 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.651843 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.652437 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.653040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.653640 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.654220 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.654823 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.655399 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.656010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.656614 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.657185 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.657797 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.658745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.659327 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.659902 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.660537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.661161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.661759 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.662367 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.662984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.663562 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.664173 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.664820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.665418 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.665992 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.666599 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.667168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.667828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.668429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.669008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.669576 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.670191 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.670771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.671363 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.671943 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.672553 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.673190 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.673810 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.674413 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.675014 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.675780 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.676159 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.676845 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.677471 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.677995 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.678599 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.679206 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.679832 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.680467 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.681091 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.682152 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.682767 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.683354 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.683941 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.684604 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.685217 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.685844 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.686425 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.687046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.687583 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.688180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.688789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.689343 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.689920 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.690594 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.691068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.691638 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.692228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.692838 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.693412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.693987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.694575 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.695711 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.696274 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.696902 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.697468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.698078 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.698737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.699298 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.699880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.700483 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.701136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.701733 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.702371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.702994 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.703755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.704187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.705021 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.705894 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.706465 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.707039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.707615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.708244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.708793 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.709335 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.709922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.710507 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.711150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.712242 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.712849 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.713436 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.714039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.714647 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.715238 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.715779 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.716345 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.716947 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.717590 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.718102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.718684 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.719250 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.719859 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.720451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.721047 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.721629 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.722242 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.722845 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.723388 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.724023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.724683 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.725221 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.725815 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.726421 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.727008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.727588 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.728242 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.728840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.729444 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.730020 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.730623 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.731219 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.731810 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.732486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.733035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.733586 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.734143 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.734726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.735311 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.735921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.736542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.737121 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.737700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.738287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.738872 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.739540 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.740128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.740852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.741439 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.742056 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.742666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.743253 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.743905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.744526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.745103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.745706 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.746307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.749254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.749254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.749254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.749254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.749755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.750363 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.750837 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.751476 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.752100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.752782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.753305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.753889 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.754493 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.755095 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.755692 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.756296 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.756913 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.758027 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.758622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.759202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.759761 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.760368 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.761049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.761585 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.762311 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.763015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.763416 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.764024 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.764628 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.765236 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.765818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.766652 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.767226 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.767800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.768362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.769068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.769654 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.770321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.770921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.771515 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.772334 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.774498 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.775085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.775643 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.776212 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.777078 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.777690 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.778315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.778962 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.779512 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.780086 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.780748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.781295 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.781888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.782683 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.783275 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.783855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.784675 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.785231 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.785785 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.787246 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.787878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.788538 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.789168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.789840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.790361 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.790994 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.791618 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.792216 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.792834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.793419 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.794033 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.794648 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.795249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.795868 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.796735 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.797375 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.797987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.798931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.800888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.800888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.801673 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.802011 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.802568 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.803891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.804763 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.805359 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.806059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.806713 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.807570 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.808419 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.809010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.809658 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.810226 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.810863 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.811477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.812170 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.813225 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.813740 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.814370 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.814986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.815578 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.816166 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.816797 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.817481 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.818089 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.818727 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.819381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.820571 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.821173 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.821813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.822413 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.823089 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.824110 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.824960 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.825605 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.826537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.827168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.827764 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.828360 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.828998 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.829555 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.830148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.830748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.831337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.831932 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.832591 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.833186 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.834035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.834694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.835290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.837287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.838215 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.839126 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.839784 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.840536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.841023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.841653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.842248 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.843248 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.843452 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.844441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.844750 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.845284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.845856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.846456 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.847062 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.847638 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.848254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.849313 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.849919 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.850522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.851520 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.852113 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.852745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.853640 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.854047 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.854631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.855231 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.855812 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.857737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.857737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.857737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.858325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.859173 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.859777 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.860429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.864293 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.865809 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.866451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.867579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.868227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.868967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.869649 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.870484 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.874893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.875873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.876580 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.878770 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.879398 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.880002 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.880631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.881251 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.881860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.882268 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.883242 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.883597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.884017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.884664 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.885015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.885534 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.885696 dv-cinder-master-3-smb devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:39.886396 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.886396 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.886677 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.887220 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.887382 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.888102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.888312 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.889228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.889972 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.890652 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.891383 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.892008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.892619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.893234 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.893804 dv-cinder-master-3-smb devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:39.893917 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.894861 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.895643 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.896172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.896920 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.897545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.898240 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.898853 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.899457 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.900044 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.900644 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.901243 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.902227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.902852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.904513 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.905134 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.905711 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.906298 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.906990 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.907718 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.908537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.910088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.910088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.910514 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.911202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.911776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.912371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.913868 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.914321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.914924 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.915499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.916249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.916906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.917515 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.918181 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.918766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.919499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.919974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.920699 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.921530 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.922186 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.922949 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.923671 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.924528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.925223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.926130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.926790 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.928320 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.928549 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.929147 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.930674 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.932175 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.932175 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.932871 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.933441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.934064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.934645 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.935241 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.935826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.937156 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.937831 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.938364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.938931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.939537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.940354 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.940754 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.941346 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.943043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.943043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.943393 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.943750 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.944470 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.945122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.946522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.946816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.947389 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.947983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.948620 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.949223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.949820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.950412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.951156 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.951792 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.952567 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.953499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.954243 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.954892 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.955541 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.956616 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.957233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.957911 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.958576 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.959527 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.960148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.961174 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.962141 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.962907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.963633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.967780 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.968585 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.969296 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.969928 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.970572 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.971166 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.971751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.972346 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.973710 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.974481 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.974927 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.975489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.976262 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.976728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.977300 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.977950 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.978595 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.979163 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.979784 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.980305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.981103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.981507 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.982104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.982787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.983285 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.983862 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.987054 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.987853 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.989171 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.989171 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.989670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.990296 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.990884 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.991635 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.992622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.993212 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.993860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.994430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.995037 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.995458 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.996066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.996610 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.997140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.997687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.998290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:39.998974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.002066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.002066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.002066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.002066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.002066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.002539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.003187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.003728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.004371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.005044 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.008153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.008153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.008153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.008153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.008614 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.009250 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.009809 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.010465 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.011124 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.011624 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.012483 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.013303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.014141 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.014892 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.015708 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.016565 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.017377 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.018098 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.018611 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 25 00:59:40.019085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120931) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 25 00:59:40.146266 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO dbcounter [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Registered counter for database nova_api Sep 25 00:59:40.183983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_db.sqlalchemy.engines [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:40.194674 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writer thread running {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:40.268362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.context [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c40cf22-5cbd-4586-b2d3-96f125e105b5(cell1) {{(pid=120931) load_cells /opt/stack/nova/nova/context.py:464}} Sep 25 00:59:40.273564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:40.274228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:40.276157 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:40.277463 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 00:59:40.277951 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 00:59:40.280801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 00:59:40.284117 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO dbcounter [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Registered counter for database nova_cell0 Sep 25 00:59:40.290537 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO dbcounter [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Registered counter for database nova_cell1 Sep 25 00:59:40.301750 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_db.sqlalchemy.engines [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:40.307442 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_db.sqlalchemy.engines [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:40.321153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writer thread running {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:40.323641 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writer thread running {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:40.418457 dv-cinder-master-3-smb devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:40.426266 dv-cinder-master-3-smb devstack@n-api.service[120932]: WARNING keystonemiddleware.auth_token [None req-293776b5-8ec6-4299-a341-2da4f1ec2acb None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:40.433909 dv-cinder-master-3-smb devstack@n-api.service[120932]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55b91b06f9c0 pid: 120932 (default app) Sep 25 00:59:40.609099 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO dbcounter [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Registered counter for database nova_cell0 Sep 25 00:59:40.620250 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_db.sqlalchemy.engines [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120931) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 25 00:59:40.626528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writer thread running {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 25 00:59:41.040214 dv-cinder-master-3-smb devstack@n-api.service[120931]: WARNING keystonemiddleware.auth_token [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:41.049266 dv-cinder-master-3-smb devstack@n-api.service[120931]: WARNING keystonemiddleware.auth_token [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:41.453421 dv-cinder-master-3-smb devstack@n-api.service[120931]: WARNING keystonemiddleware.auth_token [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 25 00:59:41.460459 dv-cinder-master-3-smb devstack@n-api.service[120931]: WARNING keystonemiddleware.auth_token [None req-defe9d8c-ab46-493e-81ae-47aeed204604 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 25 00:59:41.466993 dv-cinder-master-3-smb devstack@n-api.service[120931]: WSGI app 0 (mountpoint='') ready in 8 seconds on interpreter 0x55b91b06f9c0 pid: 120931 (default app) Sep 25 01:00:27.950826 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:27.955497 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:27.957444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:27.959273 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:29.624556 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7f7ae8d7-5fea-4002-b1ef-97de26a8adab tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f1182546f70>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:29.725059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:29.728724 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:29.733281 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:29.735795 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:30.197609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6dd5481c-75d5-407d-8a6c-da466079acda tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Action: 'create', calling method: .version_select at 0x7f1182496550>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-656704259"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:30.689646 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7f7ae8d7-5fea-4002-b1ef-97de26a8adab tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/9ac9cd0a-6ece-4aae-a71a-a14fa5f7c545" status: 200 len: 350 microversion: 2.1 time: 1.764689 Sep 25 01:00:30.707365 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 1/1] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:28 2022] GET /compute/v2.1/os-volumes/9ac9cd0a-6ece-4aae-a71a-a14fa5f7c545 => generated 350 bytes in 1785 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:31.987989 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6dd5481c-75d5-407d-8a6c-da466079acda tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.073216 Sep 25 01:00:31.988935 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 1/2] 10.222.0.26 () {60 vars in 1155 bytes} [Sun Sep 25 01:00:27 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4078 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 25 01:00:32.031203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c7c6226a-2432-4fd0-aacc-081d680ef53e tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f11823463a0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:32.254944 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c7c6226a-2432-4fd0-aacc-081d680ef53e tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9" status: 200 len: 344 microversion: 2.1 time: 0.242006 Sep 25 01:00:32.256419 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 2/3] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:32 2022] GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 => generated 344 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:32.837750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1d0c42fd-51bf-47fd-b811-fb7332a352e0 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f118236d430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:32.927534 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1d0c42fd-51bf-47fd-b811-fb7332a352e0 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/65859fb3-cb9f-4fc3-b106-e4a9481889c7" status: 200 len: 350 microversion: 2.1 time: 0.096747 Sep 25 01:00:32.928427 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 2/4] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:32 2022] GET /compute/v2.1/os-volumes/65859fb3-cb9f-4fc3-b106-e4a9481889c7 => generated 350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:33.279538 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-74866c7a-672e-44c0-9108-bdc655da3060 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182346430>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:33.441026 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-74866c7a-672e-44c0-9108-bdc655da3060 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9" status: 200 len: 345 microversion: 2.1 time: 0.166259 Sep 25 01:00:33.441970 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 3/5] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:33 2022] GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 => generated 345 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:33.475851 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-071a07e8-8d3d-4489-863a-3bdbf305c055 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Action: 'create', calling method: .version_select at 0x7f118236daf0>, body: {"snapshot": {"volume_id": "76f10313-ec4f-4d7d-963a-312f27fca5d9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1063848280"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:34.326398 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-071a07e8-8d3d-4489-863a-3bdbf305c055 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.866255 Sep 25 01:00:34.327994 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 3/6] 10.222.0.26 () {60 vars in 1162 bytes} [Sun Sep 25 01:00:33 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 870 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:34.381758 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-05a62a8f-72a2-490b-bf3b-a56eff582f07 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182346b80>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:34.544707 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-05a62a8f-72a2-490b-bf3b-a56eff582f07 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7" status: 200 len: 287 microversion: 2.1 time: 0.194781 Sep 25 01:00:34.546471 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 4/7] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Sep 25 01:00:34 2022] GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 => generated 287 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:34.561237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a91d929c-18d6-4dd2-a0fa-748827394f86 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182301ca0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:34.618025 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a91d929c-18d6-4dd2-a0fa-748827394f86 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.062416 Sep 25 01:00:34.630779 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 4/8] 10.222.0.26 () {58 vars in 1140 bytes} [Sun Sep 25 01:00:34 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:34.633907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-86b4cff6-8a0b-4033-951c-d874cfb2ad89 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f118236d1f0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:34.674086 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-86b4cff6-8a0b-4033-951c-d874cfb2ad89 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7" status: 200 len: 287 microversion: 2.1 time: 0.046509 Sep 25 01:00:34.674880 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 5/9] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Sep 25 01:00:34 2022] GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 => generated 287 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:35.293863 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-29d146dd-d208-4431-a68e-334a955c06d0 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f1182496670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:35.390463 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-29d146dd-d208-4431-a68e-334a955c06d0 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/d6c8a38b-67a0-40a0-93b1-8e2f884787c7" status: 200 len: 350 microversion: 2.1 time: 0.101248 Sep 25 01:00:35.393073 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 5/10] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:35 2022] GET /compute/v2.1/os-volumes/d6c8a38b-67a0-40a0-93b1-8e2f884787c7 => generated 350 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:35.407065 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-816c2b2d-06da-4c70-af9f-e09a26def364 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f118236d820>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:35.543514 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-816c2b2d-06da-4c70-af9f-e09a26def364 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.140577 Sep 25 01:00:35.544176 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 6/11] 10.222.0.26 () {58 vars in 1134 bytes} [Sun Sep 25 01:00:35 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:00:35.566653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a20668c5-dde9-49db-92aa-dc1553bd3ce6 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f118236daf0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:35.690561 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-83ea7685-0ed2-4954-9f10-a1f5f7ec6134 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182346700>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:35.771992 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-83ea7685-0ed2-4954-9f10-a1f5f7ec6134 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7" status: 200 len: 288 microversion: 2.1 time: 0.086391 Sep 25 01:00:35.773698 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 7/12] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Sep 25 01:00:35 2022] GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 => generated 288 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:35.793303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-539b9cf5-0f60-461e-a28a-63dfae39ddbf tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182346310>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:35.848671 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a20668c5-dde9-49db-92aa-dc1553bd3ce6 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.286380 Sep 25 01:00:35.849953 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 6/13] 10.222.0.26 () {58 vars in 1149 bytes} [Sun Sep 25 01:00:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:35.870622 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-84a92b2b-0cf9-4bfa-a231-53bcf22249b9 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f118230cdc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:35.958050 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-539b9cf5-0f60-461e-a28a-63dfae39ddbf tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "DELETE /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7" status: 202 len: 0 microversion: 2.1 time: 0.171699 Sep 25 01:00:35.959050 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 8/14] 10.222.0.26 () {58 vars in 1254 bytes} [Sun Sep 25 01:00:35 2022] DELETE /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:35.970558 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9e345c9f-d2bf-4f8a-916a-38d9c5bbcb06 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f118236d670>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:36.125764 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9e345c9f-d2bf-4f8a-916a-38d9c5bbcb06 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7" status: 200 len: 287 microversion: 2.1 time: 0.159124 Sep 25 01:00:36.126839 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 9/15] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Sep 25 01:00:35 2022] GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 => generated 287 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:36.208632 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-84a92b2b-0cf9-4bfa-a231-53bcf22249b9 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.342429 Sep 25 01:00:36.221800 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 7/16] 10.222.0.26 () {58 vars in 1134 bytes} [Sun Sep 25 01:00:35 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:00:36.248211 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d09315ae-dcde-4e28-8b5e-4911a12fed95 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f118236d040>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:36.564947 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d09315ae-dcde-4e28-8b5e-4911a12fed95 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.334122 Sep 25 01:00:36.566054 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 10/17] 10.222.0.26 () {58 vars in 1167 bytes} [Sun Sep 25 01:00:36 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:36.584017 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-992dc1b2-6d0e-48ca-b6c8-a4df657547f1 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f1182cc9940>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:36.855109 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-992dc1b2-6d0e-48ca-b6c8-a4df657547f1 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.276276 Sep 25 01:00:36.856259 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 8/18] 10.222.0.26 () {58 vars in 1170 bytes} [Sun Sep 25 01:00:36 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:36.872224 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d2da8ad5-033b-4d5a-bf88-5b990d4ff764 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f118236d1f0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.145595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-303b26eb-d8c9-44a3-b393-e4978fc4d658 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f11823015e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.151796 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d2da8ad5-033b-4d5a-bf88-5b990d4ff764 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.284108 Sep 25 01:00:37.152444 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 11/19] 10.222.0.26 () {58 vars in 1155 bytes} [Sun Sep 25 01:00:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:00:37.174571 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c781f62f-77df-47fe-b43c-d61575554dc5 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f11823464c0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.199656 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-303b26eb-d8c9-44a3-b393-e4978fc4d658 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] HTTP exception thrown: Snapshot 8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 could not be found. Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-303b26eb-d8c9-44a3-b393-e4978fc4d658 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Request method failure captured: Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 HTTP/1.1 Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6grB71wWHnopxCGNUJVtxYZ2lZ13JF12xNKUOXNdQH391Ec6XRQczoUMH3zkyk9svw9UeoGcY88jGYrIw0jVKimQzOdW8Yh2-sGJUC2VJyF2AijerLPCiXa9As0-yCoNY6GdGPiQjiakH7R88wB5wtS84yatRZX7HUiFOnNlnWewVY Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:00:37.214249 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14301d7630d542c3ba3f008820385459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14301d7630d542c3ba3f008820385459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}] Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: d6614e10f6384972a1d3d7485a7a9124 Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Snapshot 8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 could not be found. Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '8788ecf0-6c17-48d5-b1a3-5d70465dc7c7'} Sep 25 01:00:37.215417 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 could not be found. (HTTP 404) (Request-ID: req-5cf8a425-d119-4d02-a7cf-e9345d2d9783) Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:37.216212 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:37.217245 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 could not be found. Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 25 01:00:37.218237 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 could not be found. Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 could not be found. Sep 25 01:00:37.219393 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:37.223088 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-303b26eb-d8c9-44a3-b393-e4978fc4d658 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Returning 404 to user: Snapshot 8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:37.224444 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-303b26eb-d8c9-44a3-b393-e4978fc4d658 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7" status: 404 len: 111 microversion: 2.1 time: 0.082263 Sep 25 01:00:37.226601 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 9/20] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Sep 25 01:00:37 2022] GET /compute/v2.1/os-snapshots/8788ecf0-6c17-48d5-b1a3-5d70465dc7c7 => generated 111 bytes in 87 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:37.237042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7fbedd98-a42f-45da-b9d1-a768bbfc2c63 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182301040>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.353292 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7fbedd98-a42f-45da-b9d1-a768bbfc2c63 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9" status: 202 len: 0 microversion: 2.1 time: 0.118122 Sep 25 01:00:37.354493 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 10/21] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:00:37 2022] DELETE /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:00:37.365309 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1864a432-4960-4ccb-9ffb-92338385ff76 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182301d30>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.452626 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1864a432-4960-4ccb-9ffb-92338385ff76 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9" status: 200 len: 344 microversion: 2.1 time: 0.091685 Sep 25 01:00:37.453590 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 11/22] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:37 2022] GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 => generated 344 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:37.509456 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c781f62f-77df-47fe-b43c-d61575554dc5 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.338875 Sep 25 01:00:37.510048 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 12/23] 10.222.0.26 () {58 vars in 1188 bytes} [Sun Sep 25 01:00:37 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:00:37.532561 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8d1318bb-01aa-4e51-bd34-6c002e01d3e3 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] Calling method '.version_select at 0x7f1182301e50>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:37.654470 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8d1318bb-01aa-4e51-bd34-6c002e01d3e3 tempest-VolumesTestJSON-2058120869 tempest-VolumesTestJSON-2058120869-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.129854 Sep 25 01:00:37.674794 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 12/24] 10.222.0.26 () {58 vars in 1155 bytes} [Sun Sep 25 01:00:37 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:00:38.486746 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-601d99c9-e6f2-467d-816c-719ea7c8e6d8 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f1182301430>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:38.625134 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-601d99c9-e6f2-467d-816c-719ea7c8e6d8 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] HTTP exception thrown: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-601d99c9-e6f2-467d-816c-719ea7c8e6d8 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Request method failure captured: Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 HTTP/1.1 Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6grB71wWHnopxCGNUJVtxYZ2lZ13JF12xNKUOXNdQH391Ec6XRQczoUMH3zkyk9svw9UeoGcY88jGYrIw0jVKimQzOdW8Yh2-sGJUC2VJyF2AijerLPCiXa9As0-yCoNY6GdGPiQjiakH7R88wB5wtS84yatRZX7HUiFOnNlnWewVY Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:00:38.634739 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14301d7630d542c3ba3f008820385459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14301d7630d542c3ba3f008820385459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}] Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: d6614e10f6384972a1d3d7485a7a9124 Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '76f10313-ec4f-4d7d-963a-312f27fca5d9'} Sep 25 01:00:38.635883 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. (HTTP 404) (Request-ID: req-03364aae-c755-4c52-ab71-07387abd415f) Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.636583 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:38.637545 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:00:38.638431 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.639360 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-601d99c9-e6f2-467d-816c-719ea7c8e6d8 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Returning 404 to user: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:38.644361 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-601d99c9-e6f2-467d-816c-719ea7c8e6d8 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9" status: 404 len: 109 microversion: 2.1 time: 0.170828 Sep 25 01:00:38.645708 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 13/25] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:38 2022] GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 => generated 109 bytes in 175 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:38.670751 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4491f68e-e49f-4bde-869d-8b9da23f3fa9 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f118230fc10>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:38.733446 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-4491f68e-e49f-4bde-869d-8b9da23f3fa9 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] HTTP exception thrown: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4491f68e-e49f-4bde-869d-8b9da23f3fa9 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Request method failure captured: Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 HTTP/1.1 Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6grB71wWHnopxCGNUJVtxYZ2lZ13JF12xNKUOXNdQH391Ec6XRQczoUMH3zkyk9svw9UeoGcY88jGYrIw0jVKimQzOdW8Yh2-sGJUC2VJyF2AijerLPCiXa9As0-yCoNY6GdGPiQjiakH7R88wB5wtS84yatRZX7HUiFOnNlnWewVY Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:00:38.736674 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14301d7630d542c3ba3f008820385459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14301d7630d542c3ba3f008820385459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}] Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: d6614e10f6384972a1d3d7485a7a9124 Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '76f10313-ec4f-4d7d-963a-312f27fca5d9'} Sep 25 01:00:38.737795 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. (HTTP 404) (Request-ID: req-78b0476f-3457-4ab0-8056-2713cab13dbd) Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.739791 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:00:38.740712 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 01:00:38.741657 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.742539 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.747148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4491f68e-e49f-4bde-869d-8b9da23f3fa9 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Returning 404 to user: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:38.748464 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4491f68e-e49f-4bde-869d-8b9da23f3fa9 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9" status: 404 len: 109 microversion: 2.1 time: 0.083310 Sep 25 01:00:38.749553 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 13/26] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:00:38 2022] DELETE /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 => generated 109 bytes in 85 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:38.760060 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9da5be3e-f54f-4ed5-a986-d8bc6674eda0 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Calling method '.version_select at 0x7f118236d430>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:38.819051 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-9da5be3e-f54f-4ed5-a986-d8bc6674eda0 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] HTTP exception thrown: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9da5be3e-f54f-4ed5-a986-d8bc6674eda0 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Request method failure captured: Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 HTTP/1.1 Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6grB71wWHnopxCGNUJVtxYZ2lZ13JF12xNKUOXNdQH391Ec6XRQczoUMH3zkyk9svw9UeoGcY88jGYrIw0jVKimQzOdW8Yh2-sGJUC2VJyF2AijerLPCiXa9As0-yCoNY6GdGPiQjiakH7R88wB5wtS84yatRZX7HUiFOnNlnWewVY Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:00:38.821469 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_14301d7630d542c3ba3f008820385459", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/14301d7630d542c3ba3f008820385459"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/14301d7630d542c3ba3f008820385459"}]}] Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 14301d7630d542c3ba3f008820385459 Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-21826161 Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: d6614e10f6384972a1d3d7485a7a9124 Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-VolumesSnapshotsTestJSON-21826161-project Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '76f10313-ec4f-4d7d-963a-312f27fca5d9'} Sep 25 01:00:38.822810 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. (HTTP 404) (Request-ID: req-da5cf93f-329f-47bf-8c82-0c5dc4076191) Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.823602 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:38.824682 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:00:38.825708 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. Sep 25 01:00:38.827004 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:38.829506 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9da5be3e-f54f-4ed5-a986-d8bc6674eda0 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] Returning 404 to user: Volume 76f10313-ec4f-4d7d-963a-312f27fca5d9 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:38.830666 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9da5be3e-f54f-4ed5-a986-d8bc6674eda0 tempest-VolumesSnapshotsTestJSON-21826161 tempest-VolumesSnapshotsTestJSON-21826161-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9" status: 404 len: 109 microversion: 2.1 time: 0.075373 Sep 25 01:00:38.831527 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 14/27] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:38 2022] GET /compute/v2.1/os-volumes/76f10313-ec4f-4d7d-963a-312f27fca5d9 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:46.856877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-91195093-d45a-41ba-a919-c33868cbadf7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'create', calling method: .version_select at 0x7f118230f8b0>, body: {"keypair": {"name": "tempest-keypair-206421709", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP4dEiT5I0JXs8mAG6gFsQVpCzD8VnI6vCQeFE66ajgfATz/mpz+afME5I8xYUSff8aYF7h4pK4TowHgzgLqADCqsKtu2WCdWxO9Cvht64Nd1M/OQpSk42jqK1YbEU1mew=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:47.086621 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-91195093-d45a-41ba-a919-c33868cbadf7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for project 537d0a114f314e9b948150001bda642c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:00:47.107997 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-91195093-d45a-41ba-a919-c33868cbadf7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for user f32c9b07e6234d55b0d4846d44ee6ce6 and project 537d0a114f314e9b948150001bda642c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:00:47.218351 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-91195093-d45a-41ba-a919-c33868cbadf7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.757759 Sep 25 01:00:47.221220 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 14/28] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:00:46 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:00:53.499005 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2bfeecf7-c6b3-4c97-9ec4-32568e316cf1 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Action: 'create', calling method: .version_select at 0x7f118236d160>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-184378500", "metadata": {"Type": "work"}}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2bfeecf7-c6b3-4c97-9ec4-32568e316cf1 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Request method failure captured: Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 121 Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hEQMOowj5hHrktw5RMgfwEpWKuoIIfWBIgoKntlfUVYRNU5TjzxTq3MC3SqOgntH0i1mjqSgPEwJkyGNvbKlQnxPgH7DbuqIQgwf0RE7EjRX1mm2JExAEpfGUXBoLNqzVAnMScdCSFK7Z_o7yaU6gd9eUeLeewrZnpYWldRlSTrSk Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:00:53.517755 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3fabf509e3f4d78b2aff11bef5ea9ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}] Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 32fb0132312d46bea406c0e3709f683f Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-184378500", "metadata": {"Type": "work"}}} Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: Sep 25 01:00:53.519784 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-184378500', 'metadata': {'Type': 'work'}}}} Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi '#$%' Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:53.521185 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:00:53.527197 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:00:53.534589 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 25 01:00:53.534589 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.534589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2bfeecf7-c6b3-4c97-9ec4-32568e316cf1 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:53.543893 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2bfeecf7-c6b3-4c97-9ec4-32568e316cf1 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.857952 Sep 25 01:00:53.544590 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 15/29] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Sep 25 01:00:52 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 884 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:00:53.566024 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e67f24e0-c7dd-4e2c-9422-48ff3eba514f tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Action: 'create', calling method: .version_select at 0x7f1182246820>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685420285", "metadata": {"Type": "work"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e67f24e0-c7dd-4e2c-9422-48ff3eba514f tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Request method failure captured: Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 120 Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hEQMOowj5hHrktw5RMgfwEpWKuoIIfWBIgoKntlfUVYRNU5TjzxTq3MC3SqOgntH0i1mjqSgPEwJkyGNvbKlQnxPgH7DbuqIQgwf0RE7EjRX1mm2JExAEpfGUXBoLNqzVAnMScdCSFK7Z_o7yaU6gd9eUeLeewrZnpYWldRlSTrSk Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:00:53.583701 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3fabf509e3f4d78b2aff11bef5ea9ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}] Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 32fb0132312d46bea406c0e3709f683f Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1685420285", "metadata": {"Type": "work"}}} Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:00:53.586716 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1685420285', 'metadata': {'Type': 'work'}}}} Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi '0' Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:53.588285 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:00:53.594676 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:00:53.600638 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 25 01:00:53.600638 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.617533 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e67f24e0-c7dd-4e2c-9422-48ff3eba514f tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:53.620311 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e67f24e0-c7dd-4e2c-9422-48ff3eba514f tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.066996 Sep 25 01:00:53.623237 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 15/30] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Sep 25 01:00:53 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 73 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:00:53.641087 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b55cc487-8ea8-4f99-910c-bb6c3b3ed5fd tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Action: 'create', calling method: .version_select at 0x7f118236d700>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1965839233", "metadata": {"Type": "work"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b55cc487-8ea8-4f99-910c-bb6c3b3ed5fd tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Request method failure captured: Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 119 Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hEQMOowj5hHrktw5RMgfwEpWKuoIIfWBIgoKntlfUVYRNU5TjzxTq3MC3SqOgntH0i1mjqSgPEwJkyGNvbKlQnxPgH7DbuqIQgwf0RE7EjRX1mm2JExAEpfGUXBoLNqzVAnMScdCSFK7Z_o7yaU6gd9eUeLeewrZnpYWldRlSTrSk Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:00:53.651893 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3fabf509e3f4d78b2aff11bef5ea9ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}] Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 32fb0132312d46bea406c0e3709f683f Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1965839233", "metadata": {"Type": "work"}}} Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:00:53.654818 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1965839233', 'metadata': {'Type': 'work'}}}} Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise error Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi '' Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:53.657469 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 25 01:00:53.659660 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 25 01:00:53.663170 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 25 01:00:53.663170 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.663170 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b55cc487-8ea8-4f99-910c-bb6c3b3ed5fd tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:53.663170 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b55cc487-8ea8-4f99-910c-bb6c3b3ed5fd tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.023401 Sep 25 01:00:53.663170 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 16/31] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Sep 25 01:00:53 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 25 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:00:53.667824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-39446fc7-540a-43b1-9658-2bede8978199 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Calling method '.version_select at 0x7f11822145e0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:53.776350 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-39446fc7-540a-43b1-9658-2bede8978199 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] HTTP exception thrown: Volume tempest-invalid-908182974 could not be found. Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-39446fc7-540a-43b1-9658-2bede8978199 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Request method failure captured: Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-908182974 HTTP/1.1 Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hEQMOowj5hHrktw5RMgfwEpWKuoIIfWBIgoKntlfUVYRNU5TjzxTq3MC3SqOgntH0i1mjqSgPEwJkyGNvbKlQnxPgH7DbuqIQgwf0RE7EjRX1mm2JExAEpfGUXBoLNqzVAnMScdCSFK7Z_o7yaU6gd9eUeLeewrZnpYWldRlSTrSk Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:00:53.781426 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3fabf509e3f4d78b2aff11bef5ea9ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}] Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 32fb0132312d46bea406c0e3709f683f Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Volume tempest-invalid-908182974 could not be found. Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'tempest-invalid-908182974'} Sep 25 01:00:53.782917 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-908182974 could not be found. (HTTP 404) (Request-ID: req-f08cd2bb-6e87-4700-a88c-6cc5e0171c69) Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.783878 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:00:53.785521 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-908182974 could not be found. Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:53.786891 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-908182974 could not be found. Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-908182974 could not be found. Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-39446fc7-540a-43b1-9658-2bede8978199 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Returning 404 to user: Volume tempest-invalid-908182974 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-39446fc7-540a-43b1-9658-2bede8978199 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/tempest-invalid-908182974" status: 404 len: 98 microversion: 2.1 time: 0.124065 Sep 25 01:00:53.792746 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 17/32] 10.222.0.26 () {58 vars in 1215 bytes} [Sun Sep 25 01:00:53 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-908182974 => generated 98 bytes in 129 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:00:53.828686 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-efe8f107-9dfe-4831-98fc-f64125d13348 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.017370 Sep 25 01:00:53.843801 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 18/33] 10.222.0.26 () {58 vars in 1140 bytes} [Sun Sep 25 01:00:53 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 49 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 01:00:53.854894 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8c77abdd-de9f-48b7-86e8-408628da658a tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.008781 Sep 25 01:00:53.861214 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 19/34] 10.222.0.26 () {58 vars in 1137 bytes} [Sun Sep 25 01:00:53 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 25 01:00:53.876965 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86075a26-c81a-4e45-b5bc-37921fe7a924 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Calling method '.version_select at 0x7f1182204670>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:53.953268 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-86075a26-c81a-4e45-b5bc-37921fe7a924 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] HTTP exception thrown: Volume 2ffcdd15-aad9-428f-a283-98aadb5d7b16 could not be found. Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86075a26-c81a-4e45-b5bc-37921fe7a924 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Request method failure captured: Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/os-volumes/2ffcdd15-aad9-428f-a283-98aadb5d7b16 HTTP/1.1 Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hEQMOowj5hHrktw5RMgfwEpWKuoIIfWBIgoKntlfUVYRNU5TjzxTq3MC3SqOgntH0i1mjqSgPEwJkyGNvbKlQnxPgH7DbuqIQgwf0RE7EjRX1mm2JExAEpfGUXBoLNqzVAnMScdCSFK7Z_o7yaU6gd9eUeLeewrZnpYWldRlSTrSk Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:00:53.956824 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3fabf509e3f4d78b2aff11bef5ea9ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}] Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 32fb0132312d46bea406c0e3709f683f Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Volume 2ffcdd15-aad9-428f-a283-98aadb5d7b16 could not be found. Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '2ffcdd15-aad9-428f-a283-98aadb5d7b16'} Sep 25 01:00:53.958247 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2ffcdd15-aad9-428f-a283-98aadb5d7b16 could not be found. (HTTP 404) (Request-ID: req-3d082ee6-4c5d-457c-92af-1cd1abfe16b2) Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 25 01:00:53.965149 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2ffcdd15-aad9-428f-a283-98aadb5d7b16 could not be found. Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 25 01:00:53.966152 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2ffcdd15-aad9-428f-a283-98aadb5d7b16 could not be found. Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2ffcdd15-aad9-428f-a283-98aadb5d7b16 could not be found. Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-86075a26-c81a-4e45-b5bc-37921fe7a924 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Returning 404 to user: Volume 2ffcdd15-aad9-428f-a283-98aadb5d7b16 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-86075a26-c81a-4e45-b5bc-37921fe7a924 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/2ffcdd15-aad9-428f-a283-98aadb5d7b16" status: 404 len: 109 microversion: 2.1 time: 0.088870 Sep 25 01:00:53.967142 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 20/35] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:00:53 2022] DELETE /compute/v2.1/os-volumes/2ffcdd15-aad9-428f-a283-98aadb5d7b16 => generated 109 bytes in 90 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:53.970775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0342e769-3bd2-4332-8075-4d6d66ba8480 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Calling method '.version_select at 0x7f1182214b80>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:00:54.042960 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-0342e769-3bd2-4332-8075-4d6d66ba8480 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] HTTP exception thrown: Volume 3a0b3fd2-ccf5-4c61-807e-fa4210676412 could not be found. Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0342e769-3bd2-4332-8075-4d6d66ba8480 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Request method failure captured: Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/os-volumes/3a0b3fd2-ccf5-4c61-807e-fa4210676412 HTTP/1.1 Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hEQMOowj5hHrktw5RMgfwEpWKuoIIfWBIgoKntlfUVYRNU5TjzxTq3MC3SqOgntH0i1mjqSgPEwJkyGNvbKlQnxPgH7DbuqIQgwf0RE7EjRX1mm2JExAEpfGUXBoLNqzVAnMScdCSFK7Z_o7yaU6gd9eUeLeewrZnpYWldRlSTrSk Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:00:54.045163 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b3fabf509e3f4d78b2aff11bef5ea9ba", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b3fabf509e3f4d78b2aff11bef5ea9ba"}]}] Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b3fabf509e3f4d78b2aff11bef5ea9ba Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-1066997664 Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 32fb0132312d46bea406c0e3709f683f Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-1066997664-project Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Volume 3a0b3fd2-ccf5-4c61-807e-fa4210676412 could not be found. Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '3a0b3fd2-ccf5-4c61-807e-fa4210676412'} Sep 25 01:00:54.046300 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3a0b3fd2-ccf5-4c61-807e-fa4210676412 could not be found. (HTTP 404) (Request-ID: req-0d0b0a5a-8e7a-44f0-8f1b-cad2ebac127e) Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:54.047095 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:00:54.048087 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3a0b3fd2-ccf5-4c61-807e-fa4210676412 could not be found. Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:00:54.049082 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3a0b3fd2-ccf5-4c61-807e-fa4210676412 could not be found. Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3a0b3fd2-ccf5-4c61-807e-fa4210676412 could not be found. Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0342e769-3bd2-4332-8075-4d6d66ba8480 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] Returning 404 to user: Volume 3a0b3fd2-ccf5-4c61-807e-fa4210676412 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:00:54.050306 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0342e769-3bd2-4332-8075-4d6d66ba8480 tempest-VolumesNegativeTest-1066997664 tempest-VolumesNegativeTest-1066997664-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/3a0b3fd2-ccf5-4c61-807e-fa4210676412" status: 404 len: 109 microversion: 2.1 time: 0.081219 Sep 25 01:00:54.056041 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 21/36] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:00:53 2022] GET /compute/v2.1/os-volumes/3a0b3fd2-ccf5-4c61-807e-fa4210676412 => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:00:54.261246 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-141825179", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "networks": [{"uuid": "9e8a30b9-d17b-4e38-8214-0519404b74bb"}]}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:54.513449 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] validate_networks() for [('9e8a30b9-d17b-4e38-8214-0519404b74bb', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:00:57.876291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:57.878203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:00:57.905798 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1775485865", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a07d1e6-846e-499e-b152-bff6ad0aa419"}], "security_groups": [{"name": "tempest-securitygroup--26442851"}], "key_name": "tempest-keypair-206421709", "user_data": "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:00:58.458072 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] validate_networks() for [('5a07d1e6-846e-499e-b152-bff6ad0aa419', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:00:59.617479 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:00:59.622980 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:00:59.624147 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:00:59.626169 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:00:59.626899 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:00:59.664672 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:59.665776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:59.666482 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:59.667726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:00:59.668846 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:00:59.669879 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:00:59.807469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Getting quotas for project 0b369e7845314685b4145d3feaa02258. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:00:59.817946 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Getting quotas for user ef66ca98e383463994017e057c499c6f and project 0b369e7845314685b4145d3feaa02258. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:00:59.838468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:00:59.842821 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:00:59.984437 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7a30c613-5475-4d9d-87f3-30db3fa01881 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 6.381646 Sep 25 01:00:59.988865 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 16/37] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:53 2022] POST /compute/v2.1/servers => generated 380 bytes in 6387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:00.621315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-529885698", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:00.748205 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] validate_networks() for [('b6c84deb-58db-4940-b42b-a15c05ce3167', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:02.081782 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:02.082634 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:02.083775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:02.084805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:02.087346 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:02.118603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:02.119467 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:02.120493 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:02.122474 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:02.123587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:02.125560 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:02.182861 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:02.183958 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:02.184117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:02.185755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:02.186318 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:02.190284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for project 537d0a114f314e9b948150001bda642c. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:02.201125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for user f32c9b07e6234d55b0d4846d44ee6ce6 and project 537d0a114f314e9b948150001bda642c. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:02.228655 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:02.229680 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:02.230499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:02.232062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:02.242737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:02.243925 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:02.244796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:02.245949 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:02.343835 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:02.361217 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for user ca20e105b76149dd99e4aa64c62eb483 and project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:02.435998 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:02.454989 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:02.542557 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d6d7fc4f-c7f8-4768-9ade-1fbee37d3bf6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 4.667347 Sep 25 01:01:02.552169 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 22/38] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:57 2022] POST /compute/v2.1/servers => generated 400 bytes in 4678 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:01:02.795690 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9ee3ef97-d3f3-4a7d-a546-c70a9bfb26b6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.800784 Sep 25 01:01:02.797432 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 17/39] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:00:59 2022] POST /compute/v2.1/servers => generated 383 bytes in 2808 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:02.822592 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ac92cc14-9625-4542-9945-cad05335b1f9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:02.823771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ac92cc14-9625-4542-9945-cad05335b1f9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:03.133915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ac92cc14-9625-4542-9945-cad05335b1f9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:03.217461 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ac92cc14-9625-4542-9945-cad05335b1f9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1214 microversion: 2.1 time: 0.414483 Sep 25 01:01:03.222510 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 18/40] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:02 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1214 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:03.254904 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5b001a05-1035-4c09-a258-950333d878cf tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:03.262438 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5b001a05-1035-4c09-a258-950333d878cf tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:03.556292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5b001a05-1035-4c09-a258-950333d878cf tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:03.578826 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5b001a05-1035-4c09-a258-950333d878cf tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1237 microversion: 2.1 time: 0.353362 Sep 25 01:01:03.581543 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 19/41] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:03 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1237 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:03.587765 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-92e172b3-b262-4d88-af6c-b0857123ab08 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:03.592330 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-92e172b3-b262-4d88-af6c-b0857123ab08 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:03.754999 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-92e172b3-b262-4d88-af6c-b0857123ab08 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:03.765697 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-92e172b3-b262-4d88-af6c-b0857123ab08 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1221 microversion: 2.1 time: 0.182660 Sep 25 01:01:03.773203 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 20/42] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:03 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1221 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:03.871027 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6c24daf2-e347-4c13-aaaa-2b90add5b26f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'create', calling method: .version_select at 0x7f1182150160>, body: {"keypair": {"name": "tempest-keypair-1895676118", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBGZoUpqb6NnbZ7ac6VxPbYcHbl5u4jsZvTSE+CChxEkiY4gFwuHmJMPIwJh9KfMFKiLrd89cCt2ZQM0IiYyETnDFEh+BmFJpGTomsoovYQ36Zzr7VS5N3u/d+flhKlg6eA=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:03.922276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-6c24daf2-e347-4c13-aaaa-2b90add5b26f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:03.934688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-6c24daf2-e347-4c13-aaaa-2b90add5b26f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for user c468aa6d1248478286fe0a8792411a91 and project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:03.994661 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6c24daf2-e347-4c13-aaaa-2b90add5b26f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 1.440353 Sep 25 01:01:03.996962 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 23/43] 10.222.0.26 () {62 vars in 1200 bytes} [Sun Sep 25 01:01:02 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 1444 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:01:04.282526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:04.283318 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:04.302016 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:04.302571 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:04.306048 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:04.306923 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:04.312294 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:04.313292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:04.615379 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2c4aaf4b-feee-437c-9cba-8d494e141ea7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:04.621906 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2c4aaf4b-feee-437c-9cba-8d494e141ea7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:05.061249 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2c4aaf4b-feee-437c-9cba-8d494e141ea7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:05.119317 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2c4aaf4b-feee-437c-9cba-8d494e141ea7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1237 microversion: 2.1 time: 0.511836 Sep 25 01:01:05.125719 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 24/44] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:04 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1237 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:05.155289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:05.187684 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-657462556", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:05.214166 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-33636816-740e-4054-93d2-13002cb83950 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1218 microversion: 2.1 time: 0.947006 Sep 25 01:01:05.219787 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 21/45] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:04 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1218 bytes in 957 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:05.485573 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] validate_networks() for [('b6c84deb-58db-4940-b42b-a15c05ce3167', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:06.186238 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:06.192436 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:06.218379 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:06.220145 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:06.221284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:06.222900 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:06.224283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:06.225368 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:06.498939 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:06.525847 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2795cd05-3fbf-4cf0-b12d-72a3f22bb4d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1233 microversion: 2.1 time: 0.371894 Sep 25 01:01:06.547979 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 22/46] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:06 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1233 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:06.568345 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:06.570039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:06.596331 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:06.597883 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:06.603077 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:06.605629 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:06.606838 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:06.607852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:06.894204 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:06.967700 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-37565422-0c6c-4e25-8f33-d9b777c6fc1e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1266 microversion: 2.1 time: 0.407071 Sep 25 01:01:06.968906 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 23/47] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:06 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1266 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:07.589464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:07.592640 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:07.643523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.658728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.661056 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:07.672475 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:07.673917 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:07.675009 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.472357 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:08.537724 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-94fc4381-22b4-429c-973d-7f33097a8fea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1233 microversion: 2.1 time: 0.946686 Sep 25 01:01:08.551639 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 24/48] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:07 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1233 bytes in 984 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:08.580910 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:08.583081 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:08.614771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.618214 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.619309 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:08.620316 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:08.623545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:08.625905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.618442 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:09.621836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:09.622749 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:09.623621 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:09.624312 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:09.624985 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:09.678791 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9acf363b-6639-4f0d-8ec8-975bdd924bc4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1272 microversion: 2.1 time: 1.118258 Sep 25 01:01:09.684364 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 25/49] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:08 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1272 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:09.707010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:09.709345 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:09.738786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:09.739876 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:09.741359 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.742800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:09.743315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:09.743770 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.744599 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:09.746089 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:09.747247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:09.748282 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.754472 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:09.762306 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:09.857115 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:09.868111 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for user ca20e105b76149dd99e4aa64c62eb483 and project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:09.902317 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:09.916513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:10.127517 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-178ea291-c34e-4ad9-96af-9ad462bbfb58 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.984180 Sep 25 01:01:10.129558 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 25/50] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:01:05 2022] POST /compute/v2.1/servers => generated 383 bytes in 4987 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:01:10.158055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8405cbf7-8df5-4f5d-8228-388c9504af6d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:10.162241 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8405cbf7-8df5-4f5d-8228-388c9504af6d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:10.588262 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8405cbf7-8df5-4f5d-8228-388c9504af6d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:10.626721 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8405cbf7-8df5-4f5d-8228-388c9504af6d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1221 microversion: 2.1 time: 0.482320 Sep 25 01:01:10.636362 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 26/51] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:10 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1221 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:10.729533 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:10.730271 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:10.746829 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:10.756485 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:10.757890 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:10.759568 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:10.760811 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:10.762274 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:11.205985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:11.294563 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-50a83f4c-4717-461c-8dbf-986695e4c461 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1289 microversion: 2.1 time: 1.607338 Sep 25 01:01:11.386379 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 26/52] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:09 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1289 bytes in 1701 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:11.692113 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5362a689-0bb3-43f9-b9e5-8470b035015c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:11.704102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5362a689-0bb3-43f9-b9e5-8470b035015c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:12.271813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=4 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:12.761404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5362a689-0bb3-43f9-b9e5-8470b035015c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:12.843434 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5362a689-0bb3-43f9-b9e5-8470b035015c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1221 microversion: 2.1 time: 1.155354 Sep 25 01:01:12.866976 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 27/53] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:11 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1221 bytes in 1191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:12.928324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:12.938436 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:12.940801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:12.989238 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:12.990543 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3c9c886c-b183-4ab1-b28d-ab011c13935c tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1272 microversion: 2.1 time: 2.262219 Sep 25 01:01:12.994286 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:12.995838 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 27/54] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:10 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1272 bytes in 2271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:12.999593 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.006613 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.010605 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.018539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.361046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:13.402349 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d446a28c-c42b-4735-a95b-66c7d89eb8e3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1295 microversion: 2.1 time: 0.497583 Sep 25 01:01:13.403122 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 28/55] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:12 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1295 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:13.909422 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:13.910782 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:13.955363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.969474 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.972507 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:13.982571 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:13.987839 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:13.989700 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:14.032045 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:14.033182 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:14.075914 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:14.086046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:14.089305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:14.114325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:14.126490 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:14.129493 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:15.030826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:15.060142 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-93c281f6-f53f-48ab-a569-813487a8585f tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1272 microversion: 2.1 time: 1.031947 Sep 25 01:01:15.074982 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 29/56] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:14 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1272 bytes in 1048 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:15.101854 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:15.113762 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:15.115020 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:15.117445 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-92f7f7a7-a7a5-436c-9c6b-73347a635281 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1273 microversion: 2.1 time: 1.214984 Sep 25 01:01:15.122071 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 28/57] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:13 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1273 bytes in 1221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:15.155912 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:15.157343 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:15.160741 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:15.165190 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:15.167187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:15.168674 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:15.553500 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:15.606956 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8b03e538-74f5-4441-aa88-0a640561b7eb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1295 microversion: 2.1 time: 0.498134 Sep 25 01:01:15.639247 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 30/58] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:15 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1295 bytes in 554 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:16.117960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:16.118966 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:16.181499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:16.193420 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.203850 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.205480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.211726 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.217645 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.219004 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.221155 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:16.278275 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.278778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.285076 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.293274 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.293777 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.294232 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.735831 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:16.754107 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7cc3b8ee-4a1b-43e5-b5b2-3852a8ae605c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1279 microversion: 2.1 time: 0.592497 Sep 25 01:01:16.754733 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 31/59] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:16 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1279 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:16.769365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:16.770718 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:16.786646 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.787536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.789285 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.799736 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:16.800722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:16.801516 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:16.984886 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:17.001484 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3e6528c4-2396-4bb2-bf63-f10606dcb892 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1295 microversion: 2.1 time: 0.245231 Sep 25 01:01:17.005960 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 32/60] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:16 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1295 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:17.820357 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:17.831188 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:17.854323 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.869614 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.870944 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:17.872614 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:17.873854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:17.874998 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:18.754196 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:18.773049 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c94f587c-c722-4906-8845-b7f6ef1184e7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1279 microversion: 2.1 time: 0.957957 Sep 25 01:01:18.774112 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 33/61] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:17 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1279 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:18.780783 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:18.796359 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:18.807801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:18.810203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:18.813289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:18.814388 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:18.816797 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:18.819039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:19.089159 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:19.126016 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9d594749-9620-4bdb-ad40-3485448531ee tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 3.017098 Sep 25 01:01:19.129920 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 29/62] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:16 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 3023 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:19.806293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:19.807825 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:19.816851 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:19.838109 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:19.838723 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:19.839802 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:19.839802 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:19.860542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:19.861220 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.021s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.274485 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:20.297754 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1f93432f-7b95-47f9-bd65-6ae706b872bb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1295 microversion: 2.1 time: 1.522396 Sep 25 01:01:20.298398 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 34/63] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:18 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1295 bytes in 1524 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:20.319397 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:20.375609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:20.460536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:20.462551 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.025s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:20.465512 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.483492 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:20.485343 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:20.492180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:20.607209 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=20 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:21.074634 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:21.097599 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0042bf7d-fe82-4f12-b92f-17a6b5f84061 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1279 microversion: 2.1 time: 1.296008 Sep 25 01:01:21.105536 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 30/64] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:19 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1279 bytes in 1305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:21.373778 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:21.382270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:21.412351 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.421237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.429176 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.434074 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:21.439234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:21.441308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:21.778817 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:21.793295 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ed17f3b3-63fa-4ce8-bf8a-4b2d7ae4ba49 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 1.493723 Sep 25 01:01:21.794477 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 35/65] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:20 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 1495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:21.813494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1023654981", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aef7bdae-36a0-4057-bbb2-4d50f8f59c75"}], "security_groups": [{"name": "tempest-securitygroup--1577193017"}], "key_name": "tempest-keypair-1895676118", "user_data": "}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:21.911591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:21.935642 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2a11bf23-416f-4ef9-a0c5-37166da5f3f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1295 microversion: 2.1 time: 0.565990 Sep 25 01:01:21.936309 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 31/66] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:21 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1295 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:22.144909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:22.144909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:22.163981 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.164635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.165048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.166231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:22.166878 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:22.167558 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:22.550233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] validate_networks() for [('aef7bdae-36a0-4057-bbb2-4d50f8f59c75', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:01:22.790778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=20 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:23.933143 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:23.945559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=39 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:23.990837 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ff142706-69fb-4249-aa3b-8d8375609b73 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 1.862011 Sep 25 01:01:23.994445 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 32/67] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:22 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 1867 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:24.014391 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:24.015731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:24.050600 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.052583 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.053909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.055693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.056486 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.057838 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.204142 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=6 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:24.807201 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:24.824412 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9fa38ef9-498e-4978-8f1d-cc9b09455034 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.824423 Sep 25 01:01:24.825365 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 33/68] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:23 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 827 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:24.839104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:24.851636 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:24.872025 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.875813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.876735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:24.881686 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:24.885358 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:24.891182 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.307645 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:01:27.310049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:01:27.311222 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:01:27.312211 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:01:27.313265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:01:27.376416 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.376804 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.378934 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.379777 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.384201 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.384737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.432485 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=89 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:27.455487 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:27.476662 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d7fdc9aa-b046-419f-a826-003d6eddf346 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 2.648826 Sep 25 01:01:27.486330 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 34/69] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:24 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 2658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:27.528694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:01:27.548474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for user c468aa6d1248478286fe0a8792411a91 and project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:01:27.617510 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:01:27.625843 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:01:27.813825 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f5856334-19c8-4436-8ae5-64949479f215 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 6.012128 Sep 25 01:01:27.815217 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 36/70] 10.222.0.26 () {62 vars in 1188 bytes} [Sun Sep 25 01:01:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 6020 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:01:27.824007 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:27.825463 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:27.833441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.833880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.834328 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:27.835702 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:27.836171 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:27.836791 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.553515 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-7848fb9a-64e3-4635-8c98-32bc4b932081 req-8387e787-252c-408f-b402-1c9346f11104 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0a19adc9-f2ec-4759-8777-ea8dcafe17ee", "tag": "ae4eb608-7c0d-44d0-bab0-8f36c9a95ecf"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:28.560058 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=64,nova_api:INSERT=7 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:28.595091 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-7848fb9a-64e3-4635-8c98-32bc4b932081 req-8387e787-252c-408f-b402-1c9346f11104 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.595903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-7848fb9a-64e3-4635-8c98-32bc4b932081 req-8387e787-252c-408f-b402-1c9346f11104 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.599060 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-7848fb9a-64e3-4635-8c98-32bc4b932081 req-8387e787-252c-408f-b402-1c9346f11104 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.700866 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-7848fb9a-64e3-4635-8c98-32bc4b932081 req-8387e787-252c-408f-b402-1c9346f11104 service nova] Creating event network-changed:ae4eb608-7c0d-44d0-bab0-8f36c9a95ecf for instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee on hv-cinder-maste Sep 25 01:01:28.704637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-7848fb9a-64e3-4635-8c98-32bc4b932081 req-8387e787-252c-408f-b402-1c9346f11104 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:01:28.708655 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-7848fb9a-64e3-4635-8c98-32bc4b932081 req-8387e787-252c-408f-b402-1c9346f11104 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:01:28.716461 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.718334 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.719762 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.722224 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.723488 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.724255 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.778908 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.compute.rpcapi [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 25 01:01:28.788895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] Releasing lock "compute-rpcapi-router" {{(pid=120932) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:01:28.845093 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9ef9eec2-045d-4f3b-891a-d2c142154cbf None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.352283 Sep 25 01:01:28.847304 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 35/71] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1360 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:28.863481 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:28.864534 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:28.876271 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.877352 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.878108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.879216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:28.880821 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:28.881536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:28.969566 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:28.984759 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-30df93db-40af-4973-b718-8475a8fc65d3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 1.167796 Sep 25 01:01:28.992091 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 37/72] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:27 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 1176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:28.998098 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1733576c-2279-4c03-bf08-e01bd3480390 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:29.002362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1733576c-2279-4c03-bf08-e01bd3480390 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:29.158453 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1733576c-2279-4c03-bf08-e01bd3480390 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:29.182955 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1733576c-2279-4c03-bf08-e01bd3480390 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:29.186367 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1733576c-2279-4c03-bf08-e01bd3480390 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:29.189632 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1733576c-2279-4c03-bf08-e01bd3480390 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1282 microversion: 2.20 time: 0.195477 Sep 25 01:01:29.200714 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 38/73] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:28 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1282 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:29.241226 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:29.243617 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:29.278097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:29.284539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:29.289151 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:29.292760 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:29.298117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:29.301392 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:29.411204 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:29.424421 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bcbddf08-ba3f-4a5a-b67a-9b760d0a62c9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.574700 Sep 25 01:01:29.425018 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 36/74] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:28 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:29.725869 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-fcf51db3-2e8b-4c94-9f34-427b5b3e7fc0 req-b05d6967-06ca-4b0a-b232-e621c729b64d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d51dd9a7-b187-4c50-a7e5-380a2f8356f6", "tag": "056e7050-4827-4ef1-84e3-68f4134569a1"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:29.760503 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-fcf51db3-2e8b-4c94-9f34-427b5b3e7fc0 req-b05d6967-06ca-4b0a-b232-e621c729b64d service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:29.762385 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-fcf51db3-2e8b-4c94-9f34-427b5b3e7fc0 req-b05d6967-06ca-4b0a-b232-e621c729b64d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:29.764217 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-fcf51db3-2e8b-4c94-9f34-427b5b3e7fc0 req-b05d6967-06ca-4b0a-b232-e621c729b64d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:29.799909 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-fcf51db3-2e8b-4c94-9f34-427b5b3e7fc0 req-b05d6967-06ca-4b0a-b232-e621c729b64d service nova] Creating event network-changed:056e7050-4827-4ef1-84e3-68f4134569a1 for instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 on hv-cinder-maste Sep 25 01:01:29.816468 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-fcf51db3-2e8b-4c94-9f34-427b5b3e7fc0 req-b05d6967-06ca-4b0a-b232-e621c729b64d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.376082 Sep 25 01:01:29.816468 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 37/75] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:29.967054 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:29.987709 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1c8ce58b-9e56-47cb-a9f1-dcb438f8316b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.782750 Sep 25 01:01:29.992930 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 39/76] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:29 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 791 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:30.049584 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:30.050920 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:30.085903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.092087 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.093341 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.094902 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.095989 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.097269 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.230719 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:30.231352 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:30.252904 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.253414 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.259086 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.260256 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.260849 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.261301 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.597536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:30.613318 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:30.615096 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:30.616292 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-52b27e36-a5d2-4d88-ad2b-250b43106e79 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1286 microversion: 2.20 time: 0.395892 Sep 25 01:01:30.620595 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 40/77] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:30 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1286 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:30.630675 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:30.632987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:30.644881 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.645742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.646386 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.647333 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.648527 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.649124 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.766849 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:30.791955 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1d02c5c3-3a7b-4eb1-888e-7681fdd0cc22 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.755689 Sep 25 01:01:30.793941 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 38/78] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:30 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 771 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:30.931368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-56b7d8ec-e514-4fbc-b559-431046f189f2 req-fc6719b2-5eab-4f6d-93f9-281faa15eda7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837", "tag": "9739bed4-bbec-4ba0-bac9-b44811070189"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:30.947364 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-56b7d8ec-e514-4fbc-b559-431046f189f2 req-fc6719b2-5eab-4f6d-93f9-281faa15eda7 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:30.947902 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-56b7d8ec-e514-4fbc-b559-431046f189f2 req-fc6719b2-5eab-4f6d-93f9-281faa15eda7 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:30.948691 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-56b7d8ec-e514-4fbc-b559-431046f189f2 req-fc6719b2-5eab-4f6d-93f9-281faa15eda7 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:30.952545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:30.961043 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-09931b8a-2c7c-408e-818b-76e26bb93faa tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.338519 Sep 25 01:01:30.961698 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 41/79] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:30 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:30.986636 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-56b7d8ec-e514-4fbc-b559-431046f189f2 req-fc6719b2-5eab-4f6d-93f9-281faa15eda7 service nova] Creating event network-changed:9739bed4-bbec-4ba0-bac9-b44811070189 for instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 on hv-cinder-maste Sep 25 01:01:30.995648 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-56b7d8ec-e514-4fbc-b559-431046f189f2 req-fc6719b2-5eab-4f6d-93f9-281faa15eda7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.073455 Sep 25 01:01:30.996717 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 39/80] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:31.035663 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.036289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:31.048631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.049158 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.050084 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.051018 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.051544 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.052046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.307128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.334121 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b528a0ed-d9cf-4e43-b4f5-88d8038d6ccd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.297147 Sep 25 01:01:31.336560 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 42/81] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:31.675609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.677292 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:31.690821 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.691965 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.693272 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.696040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.697591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.698924 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.819231 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:31.820934 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:31.834707 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.837611 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.838189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.839407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.840308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.843013 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.843798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.859310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.863790 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:31.866476 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-27c05156-cad8-4455-8ad5-510c68585862 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1278 microversion: 2.20 time: 0.201275 Sep 25 01:01:31.881891 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 40/82] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1278 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:31.919257 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-89f432dd-0a9b-46e6-a26a-0521113f31df req-c8b30591-745e-442f-8f53-461df1f0f824 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16136bd2-3934-43b5-a833-3025f5bc3079", "tag": "e011ed57-3944-4741-9919-d93dc1c35378"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:31.938861 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-89f432dd-0a9b-46e6-a26a-0521113f31df req-c8b30591-745e-442f-8f53-461df1f0f824 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:31.940036 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-89f432dd-0a9b-46e6-a26a-0521113f31df req-c8b30591-745e-442f-8f53-461df1f0f824 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:31.940834 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-89f432dd-0a9b-46e6-a26a-0521113f31df req-c8b30591-745e-442f-8f53-461df1f0f824 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:31.973735 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-89f432dd-0a9b-46e6-a26a-0521113f31df req-c8b30591-745e-442f-8f53-461df1f0f824 service nova] Creating event network-changed:e011ed57-3944-4741-9919-d93dc1c35378 for instance 16136bd2-3934-43b5-a833-3025f5bc3079 on hv-cinder-maste Sep 25 01:01:31.984990 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-89f432dd-0a9b-46e6-a26a-0521113f31df req-c8b30591-745e-442f-8f53-461df1f0f824 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085050 Sep 25 01:01:31.986884 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 41/83] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:32.006230 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.007825 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:32.019060 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.021570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.023259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.025039 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.028110 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.029298 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.153952 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:32.178123 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-af0998b0-45aa-42bb-9792-3af46269bd4e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.364254 Sep 25 01:01:32.182299 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 43/84] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:32.382768 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.390397 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:32.432077 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.441410 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.446997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.449747 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.451504 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.456792 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.565785 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:32.589981 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2e442c07-59ba-4756-abb0-3dd7aea08447 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.600466 Sep 25 01:01:32.591300 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 42/85] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:31 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:32.850521 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:32.868658 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6bb484aa-227d-4036-b7c5-c79e2ed42897 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.493781 Sep 25 01:01:32.869807 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 44/86] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:32.926286 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:32.930258 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:32.958099 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.959785 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.961634 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:32.965287 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:32.968068 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:32.969090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.210772 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:33.212748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:33.250966 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.252084 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.254477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.256057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:33.256756 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.265564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.266551 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.288056 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:33.291871 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:33.306965 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-79bcace1-bfc2-42e0-a7e7-6783c21120de tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1278 microversion: 2.20 time: 0.389735 Sep 25 01:01:33.308061 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 43/87] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:32 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1278 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:33.637184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:33.638308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:33.669846 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.671068 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.672353 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.676138 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.677434 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.681192 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.905711 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:33.923120 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6ffa17fe-7a36-4d2a-bf48-8a70056324fa tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.719611 Sep 25 01:01:33.940430 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 45/88] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:33 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:33.940430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:33.940430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:33.953486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.953486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.953486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:33.954208 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:33.954342 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:33.958914 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.165814 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:35.202222 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1694acb5-e039-49f0-9d12-1b1a7d22f72d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 1.270791 Sep 25 01:01:35.204105 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 46/89] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:33 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 1275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:35.211653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:35.212573 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:35.250701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.252954 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.258361 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.262500 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.264304 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.269686 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.660228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:35.687786 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fff61b70-6cf7-4a98-96bd-62c1aac2f9ac tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 2.054229 Sep 25 01:01:35.689224 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 44/90] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:33 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 2061 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:35.706781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:35.716120 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:35.718308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:35.738826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:35.745209 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:35.750644 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.752572 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.754521 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.759473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:35.759646 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-16409708-7b7a-41c3-91ec-c0f614d993c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1340 microversion: 2.20 time: 0.552154 Sep 25 01:01:35.759803 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:35.761600 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:35.762365 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 47/91] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:35 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1340 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:36.250139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.255336 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:36.285246 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.286558 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.293446 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.295447 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.296586 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.297852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.490170 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:36.514084 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6e97dc00-39c2-440a-8833-993cf70fbaae tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.819304 Sep 25 01:01:36.523992 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 45/92] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:35 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:36.741921 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.744468 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:36.764535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.764535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.765038 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.766034 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.766778 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.767303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.939093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:36.954497 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-cde3a06f-e578-4f0e-b99f-6e7b6c8c0160 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.713405 Sep 25 01:01:36.956185 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 48/93] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:36 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:36.962665 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:36.963732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:36.990530 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.993042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.993655 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:36.994649 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:36.996041 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:36.996720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.131329 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:37.153123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:37.153123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:37.153123 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-cc7962b8-dd77-4b14-abdc-faa4b4c18bad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1340 microversion: 2.20 time: 0.193212 Sep 25 01:01:37.153578 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:37.155641 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 49/94] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:36 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1340 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:37.173230 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4e1b809a-bcb3-4403-b058-922f6d901062 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.439182 Sep 25 01:01:37.180451 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 46/95] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:36 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:37.545159 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:37.548943 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:37.552293 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:37.570906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:37.572141 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:37.573177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.574773 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:37.575819 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:37.576786 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:37.969337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:37.980471 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a77bbdf0-8476-4b2e-a80c-1e833f20df47 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.442787 Sep 25 01:01:37.981676 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 50/96] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:37 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:38.008624 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.011060 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:38.027917 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.028448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.031744 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.036006 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.036593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.037085 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.259781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-d3aab3fa-0d4a-4a27-8f89-fb15d56723f2 req-28550a2a-5d2a-4a93-a9e1-99a3758fb380 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a19adc9-f2ec-4759-8777-ea8dcafe17ee", "name": "network-vif-plugged", "status": "completed", "tag": "ae4eb608-7c0d-44d0-bab0-8f36c9a95ecf"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:38.293560 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d3aab3fa-0d4a-4a27-8f89-fb15d56723f2 req-28550a2a-5d2a-4a93-a9e1-99a3758fb380 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.294475 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d3aab3fa-0d4a-4a27-8f89-fb15d56723f2 req-28550a2a-5d2a-4a93-a9e1-99a3758fb380 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.295110 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d3aab3fa-0d4a-4a27-8f89-fb15d56723f2 req-28550a2a-5d2a-4a93-a9e1-99a3758fb380 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.357612 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-d3aab3fa-0d4a-4a27-8f89-fb15d56723f2 req-28550a2a-5d2a-4a93-a9e1-99a3758fb380 service nova] Creating event network-vif-plugged:ae4eb608-7c0d-44d0-bab0-8f36c9a95ecf for instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee on hv-cinder-maste Sep 25 01:01:38.358481 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d3aab3fa-0d4a-4a27-8f89-fb15d56723f2 req-28550a2a-5d2a-4a93-a9e1-99a3758fb380 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 25 01:01:38.359038 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d3aab3fa-0d4a-4a27-8f89-fb15d56723f2 req-28550a2a-5d2a-4a93-a9e1-99a3758fb380 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 25 01:01:38.360591 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.360909 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.361361 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.362146 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.362600 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.363283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.373570 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.compute.rpcapi [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 25 01:01:38.374486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] Releasing lock "compute-rpcapi-router" {{(pid=120931) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 25 01:01:38.396731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:38.408806 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-56b69239-d406-47fe-a3a5-d58077001fe3 None None] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.336636 Sep 25 01:01:38.409879 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 51/97] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:38.420789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.421353 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-875e9666-f8be-490d-8548-92753fffeaa5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.436448 Sep 25 01:01:38.422196 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 47/98] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:37 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:38.424475 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:38.433805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:38.437478 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:38.441517 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.442009 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.447097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.448595 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.449684 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.451715 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.452538 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.458548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.459310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.460606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:38.461431 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:38.461875 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:38.637173 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:38.661562 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:38.661562 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:38.672926 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-05619555-d237-4e5f-a7f7-f0e585effcce tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1340 microversion: 2.20 time: 0.261358 Sep 25 01:01:38.673647 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 52/99] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:38 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1340 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:38.764950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:38.842310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:38.856048 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cbcdfba8-4698-4419-a13e-563b1600e87e tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.432477 Sep 25 01:01:38.856781 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 48/100] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:38 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 434 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:39.020751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:39.023189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:39.035709 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.036276 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.037056 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.037928 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.038974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.039608 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.167391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=8 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:39.362889 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:39.374781 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-922aaf5f-7c3f-409a-abf0-83cccc1d3507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.359173 Sep 25 01:01:39.376234 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 53/101] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:39 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:39.478796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:39.479824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:39.495970 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.496866 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.504153 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.505636 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.506653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.507420 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.703406 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:39.704582 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:39.716598 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.717305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.718060 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.719010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:39.719732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:39.720421 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:39.939718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:39.940187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:39.960131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:39.983953 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-82ca09d0-de0f-49ae-b4aa-21bb58ee2e27 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.520920 Sep 25 01:01:39.996842 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 49/102] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:39 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:39.997000 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:39.997000 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:40.000786 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-aa618967-4e24-4b46-b1ca-45cf4fc2c247 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1340 microversion: 2.20 time: 0.301562 Sep 25 01:01:40.001976 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 54/103] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:39 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1340 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:40.019566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:40.023134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:40.051400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.052294 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.053123 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.055609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.056724 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.057708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.418373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:40.419448 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:40.436542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.440912 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.444819 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.446495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:40.447537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:40.448316 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:40.608497 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:40.628105 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1ca2e8af-5261-4ff9-b41c-7c76f37add8b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.637347 Sep 25 01:01:40.631721 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 50/104] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:39 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 644 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:40.777854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:40.799470 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-60a8d268-5066-4818-a6d0-e96bc0d870d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.384677 Sep 25 01:01:40.803068 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 55/105] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:40 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:41.032080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:41.033841 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:41.045331 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.046338 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.047206 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.048322 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.049118 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.049836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.052462 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:41.053477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:41.063247 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.064628 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.066287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.067842 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.069383 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.070453 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.312200 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:41.323218 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:41.324973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:41.326178 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-31a943a8-88f2-41a1-ad45-f633100292a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.280657 Sep 25 01:01:41.342341 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 56/106] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:41 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:41.451154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:41.455516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:41.469213 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-81b05a1c-5d1b-4efd-bf20-f9b6561fcd61 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.441872 Sep 25 01:01:41.469824 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 51/107] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:41 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:41.675961 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:41.677115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:41.691059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.692600 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.694058 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.695772 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.696660 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.697376 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.833042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:41.836347 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:41.851239 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.852739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.854683 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.855831 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:41.856723 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:41.857450 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:41.961762 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:41.972194 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-42a90eae-d3c0-411b-8826-f363f176eb77 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.303672 Sep 25 01:01:41.973262 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 57/108] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:41 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:42.066116 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:42.075393 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b1670fab-4ed9-4385-95d2-96bff4716bb6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.250851 Sep 25 01:01:42.088983 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 52/109] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:41 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:42.386651 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:42.388470 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:42.398297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.399163 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.399990 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.401126 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.402074 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.402722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.435451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-b11742f2-76ef-4cba-8998-336172ecff05 req-faa44eb7-bbe3-482f-8197-9a488d59a0bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16136bd2-3934-43b5-a833-3025f5bc3079", "name": "network-vif-plugged", "status": "completed", "tag": "e011ed57-3944-4741-9919-d93dc1c35378"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:42.449421 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b11742f2-76ef-4cba-8998-336172ecff05 req-faa44eb7-bbe3-482f-8197-9a488d59a0bc service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.450401 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b11742f2-76ef-4cba-8998-336172ecff05 req-faa44eb7-bbe3-482f-8197-9a488d59a0bc service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.450943 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b11742f2-76ef-4cba-8998-336172ecff05 req-faa44eb7-bbe3-482f-8197-9a488d59a0bc service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.495063 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-b11742f2-76ef-4cba-8998-336172ecff05 req-faa44eb7-bbe3-482f-8197-9a488d59a0bc service nova] Creating event network-vif-plugged:e011ed57-3944-4741-9919-d93dc1c35378 for instance 16136bd2-3934-43b5-a833-3025f5bc3079 on hv-cinder-maste Sep 25 01:01:42.515800 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-b11742f2-76ef-4cba-8998-336172ecff05 req-faa44eb7-bbe3-482f-8197-9a488d59a0bc service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.085245 Sep 25 01:01:42.517110 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 53/110] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:42.525325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:42.536048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:42.553577 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.558680 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.559575 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.560543 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:42.561149 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:42.561717 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:42.742984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:42.760636 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:42.762735 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:42.764469 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ebf566a6-4483-4d73-9bf1-8d0722f4cb16 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.385337 Sep 25 01:01:42.765056 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 58/111] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:42 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:42.824056 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:42.839131 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a23aa67e-100f-470e-b0dc-46892efbd6e8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.319768 Sep 25 01:01:42.840771 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 54/112] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:42 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:43.009294 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:43.010524 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:43.022319 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.023361 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.024329 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.026118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.027201 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.028338 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.101941 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:43.103975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:43.116090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.117447 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.118178 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.119266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.120025 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.120751 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.323600 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:43.337961 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-52f39d3d-6608-4af6-84ca-96df2e0c9855 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.337460 Sep 25 01:01:43.340028 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 59/113] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:42 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:43.411049 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:43.454585 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-96df0df9-83e6-4b1c-8efe-43a57d9eca45 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.357331 Sep 25 01:01:43.469140 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 55/114] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:43 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:43.809065 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:43.811188 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:43.833604 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.836997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.838773 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.841079 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.842795 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.845031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.894180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:43.905867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:43.952180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.955763 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.966353 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:43.969683 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:43.981634 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:43.990282 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:44.659510 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:44.679095 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:44.688618 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:44.691135 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-15e4efab-666f-4f7b-bcbd-59158cb43fe1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.893995 Sep 25 01:01:44.696620 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 60/115] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:43 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 901 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:44.719883 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:44.724735 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:44.751782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:44.752679 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:44.754994 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:44.756414 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:44.763314 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:44.764494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:45.744740 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:45.761520 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-036f7b8e-4110-41f1-9e46-e41be8e17b40 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 1.879462 Sep 25 01:01:45.763256 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 56/116] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:43 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 1884 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:45.773371 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:45.775844 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:45.789329 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:45.790305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:45.791335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:45.792510 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:45.793371 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:45.794207 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:45.903535 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:45.919477 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ccdfbc2a-900a-4474-a97b-6870e5a818fd tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 1.220692 Sep 25 01:01:45.921372 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 61/117] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:44 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 1224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:45.927156 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:45.928062 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:45.939093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:45.939922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:45.940908 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:45.941933 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:45.942967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:45.943896 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:46.191596 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:46.219863 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d0fda387-c18a-472d-a57d-53f85f1b238e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.454879 Sep 25 01:01:46.236423 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 57/118] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:45 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:46.319588 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:46.361467 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:46.365829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:46.369086 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ff9e5791-3681-4a52-8fef-4830f7555579 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.445807 Sep 25 01:01:46.370487 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 62/119] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:45 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:46.792528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:46.800611 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:46.827883 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:46.831425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:46.833546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:46.837513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:46.838986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:46.840095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:46.970196 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:46.974740 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:46.989097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:46.990321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:46.991992 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:46.993669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:46.996526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:46.997730 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.357859 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:47.373540 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ac0546c8-b5c9-4af6-b0a2-a7b2e210d1c5 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.415287 Sep 25 01:01:47.374903 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 63/120] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:46 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:47.391963 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:47.392877 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:47.401429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.403567 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.409542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.410888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.411756 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.415839 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.695055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:47.712995 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9f85a311-cd22-4d1b-b7f9-1973e79e2bd3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.928915 Sep 25 01:01:47.714780 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 58/121] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:46 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 932 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:47.725461 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:47.727083 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:47.742603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.743534 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.744796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.746361 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:47.747206 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:47.748687 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:47.758798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:47.780002 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-33e83c07-f8da-4404-89b4-c5d92241126e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.402984 Sep 25 01:01:47.781685 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 64/122] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:47 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:48.325407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-176c02ea-b926-4715-9bd3-e20038075c3d req-7f348db8-6cb0-4fcd-82ef-adcee68022cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3594bb0-3667-44b5-badd-3dcfe8b74c27", "tag": "8914da89-09c9-40c1-90d8-87e916c3a872"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:48.338740 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-176c02ea-b926-4715-9bd3-e20038075c3d req-7f348db8-6cb0-4fcd-82ef-adcee68022cd service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.339611 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-176c02ea-b926-4715-9bd3-e20038075c3d req-7f348db8-6cb0-4fcd-82ef-adcee68022cd service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.340619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-176c02ea-b926-4715-9bd3-e20038075c3d req-7f348db8-6cb0-4fcd-82ef-adcee68022cd service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.375898 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:48.381063 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-176c02ea-b926-4715-9bd3-e20038075c3d req-7f348db8-6cb0-4fcd-82ef-adcee68022cd service nova] Creating event network-changed:8914da89-09c9-40c1-90d8-87e916c3a872 for instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 on hv-cinder-maste Sep 25 01:01:48.397334 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-176c02ea-b926-4715-9bd3-e20038075c3d req-7f348db8-6cb0-4fcd-82ef-adcee68022cd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080290 Sep 25 01:01:48.398351 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 65/123] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:48.432079 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:48.433464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:48.436677 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:48.452709 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.453791 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.454609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.456566 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.457430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.458253 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.459254 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:48.465080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:48.469698 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1cad5b3a-231d-4e8d-b861-8c9779d81757 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.749767 Sep 25 01:01:48.472490 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 59/124] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:47 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:48.749587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:48.750797 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:48.784198 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:48.809665 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d4cb3b22-e5c0-436b-ac8d-44c4f9ffc140 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1314 microversion: 2.1 time: 0.393928 Sep 25 01:01:48.812002 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 66/125] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:48 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1314 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:48.835333 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:48.836512 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:48.849633 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.851766 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.853136 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.855698 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.857407 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.858555 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.903265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.904183 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.905074 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:48.906550 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:48.907443 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:48.908618 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:49.367713 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:49.427545 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b97e4df0-5f90-43fd-ac4e-750851f9f6ed tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.606585 Sep 25 01:01:49.431552 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 67/126] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:48 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 614 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:49.516558 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:49.528399 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:49.529974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:49.533909 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c2758504-7e81-450e-acbd-5bcfe1622e7b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1361 microversion: 2.1 time: 0.794166 Sep 25 01:01:49.534534 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 60/127] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:48 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1361 bytes in 796 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:49.560816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:49.561698 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:49.562468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:49.564496 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:49.568775 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:49.569727 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:49.800366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ce7eb992-780c-489e-b4fe-de32a26b37e4 req-63f84eb4-e552-48fd-9d74-9cafc110c58b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51dd9a7-b187-4c50-a7e5-380a2f8356f6", "name": "network-vif-plugged", "status": "completed", "tag": "056e7050-4827-4ef1-84e3-68f4134569a1"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:49.834624 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ce7eb992-780c-489e-b4fe-de32a26b37e4 req-63f84eb4-e552-48fd-9d74-9cafc110c58b service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:49.835325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ce7eb992-780c-489e-b4fe-de32a26b37e4 req-63f84eb4-e552-48fd-9d74-9cafc110c58b service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:49.844994 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ce7eb992-780c-489e-b4fe-de32a26b37e4 req-63f84eb4-e552-48fd-9d74-9cafc110c58b service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:49.900073 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ce7eb992-780c-489e-b4fe-de32a26b37e4 req-63f84eb4-e552-48fd-9d74-9cafc110c58b service nova] Creating event network-vif-plugged:056e7050-4827-4ef1-84e3-68f4134569a1 for instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 on hv-cinder-maste Sep 25 01:01:49.961035 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ce7eb992-780c-489e-b4fe-de32a26b37e4 req-63f84eb4-e552-48fd-9d74-9cafc110c58b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.158405 Sep 25 01:01:49.969783 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 61/128] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:50.022152 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:50.027886 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:50.068986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:50.075151 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:50.086752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:50.089550 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:50.092863 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:50.102144 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:50.113986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:50.146801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:50.150823 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:50.160787 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9f1c7666-7cd6-4d20-83f1-1ebfed81c0fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.639991 Sep 25 01:01:50.180897 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 68/129] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:49 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:50.497371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:50.498890 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:50.515606 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:50.516741 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:50.517757 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:50.519228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:50.520180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:50.521256 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:50.704048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:50.716654 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d405fcc0-88fa-4997-844c-2eff6cbdac93 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1502 microversion: 2.1 time: 0.727767 Sep 25 01:01:50.717638 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 62/130] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:49 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1502 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:50.725714 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:50.726433 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:50.750946 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:50.752931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:50.754315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:50.755231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:50.756021 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:50.756855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:50.781289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:50.797989 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b89d39b8-3f4c-445d-9ac6-ddbd06f396ac tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.341042 Sep 25 01:01:50.798981 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 69/131] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:50 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:51.227126 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:51.227740 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:51.242036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.242806 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.243391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.244418 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.245046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.258697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.527744 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:51.540649 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7e0d24bf-5fac-49bc-ab51-6e89487af59c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1547 microversion: 2.1 time: 0.819969 Sep 25 01:01:51.542488 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 63/132] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:50 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1547 bytes in 824 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:51.594203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:51.600089 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:51.608607 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:51.622477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.622477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.622477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.622477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.623415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.623415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.635335 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:51.639148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:51.644578 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9db29b69-34b7-44a4-8d71-4a4b1ab49943 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.420519 Sep 25 01:01:51.648315 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 70/133] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:51 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:51.833701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:51.834799 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:51.862932 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.864354 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.865589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.868271 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:51.869907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:51.870734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:51.990677 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-97ec479c-7456-4fb7-be09-33ffe14e9108 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.406136 Sep 25 01:01:51.992578 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 64/134] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:01:51 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-interface => generated 285 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:52.071484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-72ab3e91-a5c5-4f12-be5c-8c0971febb00 req-a06bd100-49c1-4678-8e84-eb37cecd175b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837", "name": "network-vif-plugged", "status": "completed", "tag": "9739bed4-bbec-4ba0-bac9-b44811070189"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:52.090065 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-72ab3e91-a5c5-4f12-be5c-8c0971febb00 req-a06bd100-49c1-4678-8e84-eb37cecd175b service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.090730 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-72ab3e91-a5c5-4f12-be5c-8c0971febb00 req-a06bd100-49c1-4678-8e84-eb37cecd175b service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.091307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-72ab3e91-a5c5-4f12-be5c-8c0971febb00 req-a06bd100-49c1-4678-8e84-eb37cecd175b service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:52.124373 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-72ab3e91-a5c5-4f12-be5c-8c0971febb00 req-a06bd100-49c1-4678-8e84-eb37cecd175b service nova] Creating event network-vif-plugged:9739bed4-bbec-4ba0-bac9-b44811070189 for instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 on hv-cinder-maste Sep 25 01:01:52.133066 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-72ab3e91-a5c5-4f12-be5c-8c0971febb00 req-a06bd100-49c1-4678-8e84-eb37cecd175b service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065932 Sep 25 01:01:52.139287 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 65/135] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:52.162001 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:52.177359 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c10b90b7-cef0-4b15-b1ee-81b4a1c86bc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.351058 Sep 25 01:01:52.178506 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 71/136] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:51 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:52.687373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:52.713114 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7a2eb2ee-de70-41fd-97a6-71ee3da2794c"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:52.718948 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:52.724241 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:52.738384 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.739488 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.740468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:52.742001 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.743246 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.743508 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.744406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.744691 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:52.745667 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:52.750306 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:52.751150 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:52.752740 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:52.794326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:53.627329 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0cb98c01-f47d-4d6c-921f-de33e2acecfe tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "POST /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.925822 Sep 25 01:01:53.636274 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 72/137] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:01:52 2022] POST /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee/os-volume_attachments => generated 194 bytes in 936 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:01:53.676745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:53.676745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:53.700016 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:53.700848 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:53.709023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:53.710748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:53.715032 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:53.717356 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:53.793605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:53.827278 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:53.833818 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:53.837638 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d155d880-5b7d-40d7-93df-5c241c27bdbc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 1.165067 Sep 25 01:01:53.839897 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 66/138] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:52 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 1169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:54.170312 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:54.203917 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c1f7353c-4725-402e-8b37-a685bf36f2d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.545795 Sep 25 01:01:54.205324 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 73/139] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:53 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:54.896842 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:54.909912 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:54.919895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:54.920618 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:54.921209 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:54.922546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:54.922778 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:54.923222 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.242723 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:55.243348 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:55.246528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:55.253808 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:55.254774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:55.255489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.256775 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:55.257637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:55.258181 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.362284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:55.391616 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:55.398399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:55.404567 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b5f47acc-712d-4a80-99f8-d14a1f5d9802 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.514441 Sep 25 01:01:55.405808 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 67/140] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:54 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:01:55.622174 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:55.654920 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7879dfc8-1a07-467b-aa51-4b471784613d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.416553 Sep 25 01:01:55.656862 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 74/141] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:55 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:55.719498 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-c1138d0e-a887-4dc6-b4f7-42865e5726f4 req-eb23d97e-185a-43e5-b1e0-36484223737d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "16136bd2-3934-43b5-a833-3025f5bc3079", "tag": "e011ed57-3944-4741-9919-d93dc1c35378"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:55.748608 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c1138d0e-a887-4dc6-b4f7-42865e5726f4 req-eb23d97e-185a-43e5-b1e0-36484223737d service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:55.750190 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c1138d0e-a887-4dc6-b4f7-42865e5726f4 req-eb23d97e-185a-43e5-b1e0-36484223737d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:55.751541 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c1138d0e-a887-4dc6-b4f7-42865e5726f4 req-eb23d97e-185a-43e5-b1e0-36484223737d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:55.779524 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-c1138d0e-a887-4dc6-b4f7-42865e5726f4 req-eb23d97e-185a-43e5-b1e0-36484223737d service nova] Creating event network-changed:e011ed57-3944-4741-9919-d93dc1c35378 for instance 16136bd2-3934-43b5-a833-3025f5bc3079 on hv-cinder-maste Sep 25 01:01:55.790202 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-c1138d0e-a887-4dc6-b4f7-42865e5726f4 req-eb23d97e-185a-43e5-b1e0-36484223737d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079590 Sep 25 01:01:55.792285 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 68/142] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:01:56.449386 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:56.450258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:56.470610 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:56.471177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:56.472991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:56.476442 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:56.479402 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:56.480239 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:56.698114 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:56.708444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:56.752164 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:56.792917 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:56.795112 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.041s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:56.797452 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:56.798048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:56.798616 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:56.930720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:56.979862 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:56.996772 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:57.009796 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-fe86d6a1-e290-41b3-9b9d-5c81a8aee14d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.552280 Sep 25 01:01:57.013315 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 75/143] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:56 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:57.150290 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:57.161369 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c2729b30-7f2e-4de4-ae1c-b90b907648fd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1321 microversion: 2.1 time: 0.482507 Sep 25 01:01:57.162248 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 69/144] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:56 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1321 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:58.049357 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:58.051432 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:58.069220 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.073978 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.075115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.077905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.080179 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.081610 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.195559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:58.196362 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:58.214370 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.216861 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.220007 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.221154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.221733 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.222174 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.608280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:58.623730 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:58.627661 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:58.629557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:58.634084 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-90574c24-7b68-471d-bbbe-2ca245e2b120 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.590742 Sep 25 01:01:58.635383 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 76/145] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:58 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:01:58.646694 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fa0e499b-5fd9-4929-afcd-28c2d57525ec tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1516 microversion: 2.1 time: 0.454741 Sep 25 01:01:58.647981 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 70/146] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:58 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1516 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:01:58.694277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:01:58.698078 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:58.706015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.706691 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.707249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.708604 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.709203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:58.710620 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:58.750631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'flavor' on Instance uuid 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:01:58.973716 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5ec323b9-4e63-4eb7-a9e6-d65ece0e42a5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837/action" status: 200 len: 32 microversion: 2.1 time: 0.283680 Sep 25 01:01:58.979728 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 77/147] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:01:58 2022] POST /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837/action => generated 32 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:01:58.985625 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:58.987016 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:58.994146 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=72 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:58.997600 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:58.998841 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:59.000175 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:59.001451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:59.002154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:59.002804 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:59.033204 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:01:59.489639 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:01:59.528118 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-db270fce-ef2a-43d3-ba5c-b8629cc6d643 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.544008 Sep 25 01:01:59.532081 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 71/148] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:01:58 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:01:59.689712 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:01:59.691510 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:01:59.700915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:59.700915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:59.701748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:01:59.702790 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:01:59.703376 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:01:59.703997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:00.019464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:00.045959 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:00.087008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:00.088421 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-607b3f8b-1217-40dc-8957-dcf5df521d39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.404855 Sep 25 01:02:00.091409 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 78/149] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:01:59 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:02:00.565356 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:00.567129 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:00.586520 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:00.587610 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:00.588356 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:00.589635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:00.590514 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:00.591258 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.017265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:01.019118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:01.030756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:01.034949 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.037042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.039521 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.041178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.042353 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.043389 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.063346 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d8b299d7-62c2-45ce-9703-867821fcf08c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.504264 Sep 25 01:02:01.063346 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 72/150] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:00 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:01.117091 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:01.117769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:01.133224 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:02:01.133669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.136820 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.137678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.142861 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.146753 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.147938 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.328509 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2c7c4d26-43c7-4113-bdc6-293dbc96c588 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 204 len: 0 microversion: 2.1 time: 0.325937 Sep 25 01:02:01.330050 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 79/151] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:02:00 2022] DELETE /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 0 bytes in 330 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:02:01.360672 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:01.364436 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:01.377579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.378861 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.379811 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.380167 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:01.381547 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:01.382966 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:01.384175 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:01.393580 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:01.396259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:01.398891 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f0ff86fd-7c44-420d-a935-f8d3a5f7969c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.286013 Sep 25 01:02:01.412105 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 73/152] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:02:01 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:02:01.603328 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:01.631379 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-891d860e-bf55-40e3-a5c0-76f883e273cf tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1554 microversion: 2.1 time: 0.293280 Sep 25 01:02:01.634272 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 80/153] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:01 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1554 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:02.090054 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:02.090921 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:02.106878 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.107503 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.107962 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.108756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.109229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.109662 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.431931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:02.432899 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:02.459353 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.462870 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.468069 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.472722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.476223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.478385 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.557739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:02.583380 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bb2806f7-6103-4201-9992-cc700bba99cc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.498187 Sep 25 01:02:02.590757 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 74/154] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:02 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:02.664412 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:02.665873 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:02.693162 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.694745 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.695822 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.699023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:02.701827 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:02.702987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:02.864563 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:02.903669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:02.909637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:02.917586 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-cc069597-b630-482e-bfd8-fe1a4540851e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.489832 Sep 25 01:02:02.918859 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 81/155] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:02:02 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:02:03.095286 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:03.112900 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-72d72d9c-11ae-4f7c-b3c2-13581609f435 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1554 microversion: 2.1 time: 0.452361 Sep 25 01:02:03.112900 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 75/156] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:02 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1554 bytes in 454 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:03.473577 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-5b565286-f55a-4e16-8b07-dce1f98206cb req-a9c2b6a0-d40a-4a0a-91db-e959649c61a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3594bb0-3667-44b5-badd-3dcfe8b74c27", "name": "network-vif-plugged", "status": "completed", "tag": "8914da89-09c9-40c1-90d8-87e916c3a872"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:03.510071 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-5b565286-f55a-4e16-8b07-dce1f98206cb req-a9c2b6a0-d40a-4a0a-91db-e959649c61a4 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:03.510588 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-5b565286-f55a-4e16-8b07-dce1f98206cb req-a9c2b6a0-d40a-4a0a-91db-e959649c61a4 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:03.513576 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-5b565286-f55a-4e16-8b07-dce1f98206cb req-a9c2b6a0-d40a-4a0a-91db-e959649c61a4 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:03.553058 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-5b565286-f55a-4e16-8b07-dce1f98206cb req-a9c2b6a0-d40a-4a0a-91db-e959649c61a4 service nova] Creating event network-vif-plugged:8914da89-09c9-40c1-90d8-87e916c3a872 for instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 on hv-cinder-maste Sep 25 01:02:03.568451 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-5b565286-f55a-4e16-8b07-dce1f98206cb req-a9c2b6a0-d40a-4a0a-91db-e959649c61a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103563 Sep 25 01:02:03.570562 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 82/157] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:03.641202 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:03.641920 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:03.650679 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:03.651171 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:03.651800 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:03.652909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:03.653908 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:03.654654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:03.894498 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:03.904274 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b3f93278-86dd-47fb-b7df-ccb41ed40ce9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.269567 Sep 25 01:02:03.905016 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 76/158] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:03 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:03.969615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:03.971014 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:03.997432 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:03.999075 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.000357 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:04.003967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:04.011300 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.012231 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:04.153363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:04.159712 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:04.173595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:04.175043 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.176142 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:04.179756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:04.181275 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.182380 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:04.450291 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:04.468449 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:04.476999 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:04.480508 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5dedc612-c9c4-41d5-8ef9-c13b91d12d32 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.520211 Sep 25 01:02:04.484041 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 83/159] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:02:03 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:02:04.932997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:04.934072 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:04.958412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:04.959071 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.959788 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:04.964538 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:04.968373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:04.969480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:05.012906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:05.300639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:05.302604 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:05.330008 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-dce020f6-8403-4920-999f-642b60f03b0c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.402914 Sep 25 01:02:05.331585 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 84/160] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:04 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:05.336290 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-94492616-4e93-4ba9-90cb-16452c1228ae tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1554 microversion: 2.1 time: 1.197399 Sep 25 01:02:05.337420 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 77/161] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:04 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1554 bytes in 1200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:05.530382 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:05.532841 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:05.545776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:05.547371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:05.548496 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:05.550099 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:05.551265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:05.552324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:05.887178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:05.910910 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:05.914738 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:05.917915 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2b52c774-fc41-4ec6-8a41-03020d946d0c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.394097 Sep 25 01:02:05.919547 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 85/162] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:02:05 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:02:06.150242 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-3186d82c-5dda-498a-abb2-fd73fbe15e67 req-1a6176fd-26ed-4f23-b249-2e4742e52cc9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0a19adc9-f2ec-4759-8777-ea8dcafe17ee", "name": "network-vif-deleted", "tag": "ae4eb608-7c0d-44d0-bab0-8f36c9a95ecf"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:06.168744 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3186d82c-5dda-498a-abb2-fd73fbe15e67 req-1a6176fd-26ed-4f23-b249-2e4742e52cc9 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.169233 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3186d82c-5dda-498a-abb2-fd73fbe15e67 req-1a6176fd-26ed-4f23-b249-2e4742e52cc9 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.169847 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3186d82c-5dda-498a-abb2-fd73fbe15e67 req-1a6176fd-26ed-4f23-b249-2e4742e52cc9 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.229492 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-3186d82c-5dda-498a-abb2-fd73fbe15e67 req-1a6176fd-26ed-4f23-b249-2e4742e52cc9 service nova] Creating event network-vif-deleted:ae4eb608-7c0d-44d0-bab0-8f36c9a95ecf for instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee on hv-cinder-maste Sep 25 01:02:06.253714 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-3186d82c-5dda-498a-abb2-fd73fbe15e67 req-1a6176fd-26ed-4f23-b249-2e4742e52cc9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.107599 Sep 25 01:02:06.260246 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 78/163] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:02:06.365748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:06.366905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:06.376862 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:06.380525 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:06.392237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.392895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.393483 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.394388 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.395572 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.396427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.416061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.417308 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.418063 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.419289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.420088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.427605 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.699945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:06.737899 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ba8f28b7-9008-4e73-89d3-95c965d466b4 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1512 microversion: 2.1 time: 0.377387 Sep 25 01:02:06.755545 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 86/164] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:06 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1512 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:06.806823 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:06.822797 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-63c4a8ea-a82f-4241-978e-391f4cf2b3d4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.453264 Sep 25 01:02:06.823528 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 79/165] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:06 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:06.953855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:06.954575 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:06.966627 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.967149 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.967594 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:06.968557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:06.970153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:06.970782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.258086 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:07.271001 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:07.279843 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:07.282095 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f8bdeb30-5581-4737-9955-c3d5e4790054 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1408 microversion: 2.20 time: 0.333233 Sep 25 01:02:07.283903 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 87/166] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:02:06 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1408 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:02:07.796517 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:07.799825 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:07.830812 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:07.832725 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:07.833821 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.835835 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:07.837365 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:07.838425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.855635 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:07.859615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:07.893172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:07.894429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:07.895576 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.897432 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:07.898969 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:07.899967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.943073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:07.944210 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:07.944981 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:07.945758 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lazy-loading 'fault' on Instance uuid 0a19adc9-f2ec-4759-8777-ea8dcafe17ee {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:08.138122 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ef66ca98e383463994017e057c499c6f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b369e7845314685b4145d3feaa02258', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:08.159577 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c3e1c175-71eb-4376-8168-e650aecfcada tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 200 len: 1350 microversion: 2.1 time: 0.384301 Sep 25 01:02:08.160531 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 80/167] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:07 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 1350 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:08.322775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:08.323972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:08.348019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:08.348574 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:08.349035 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:08.351365 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:08.351853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:08.352595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:08.355773 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:08.378032 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-72f8f675-6e95-4598-9d49-e852c851e8c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.532887 Sep 25 01:02:08.379121 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 88/168] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:07 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:08.730276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:08.749000 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:08.749000 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:08.749000 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3002222f-81e1-435f-bd5a-c969338452f3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1598 microversion: 2.20 time: 0.431486 Sep 25 01:02:08.755046 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 81/169] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:02:08 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1598 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:02:08.803636 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:08.805633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:08.820217 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:08.821378 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:08.822198 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:08.824039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:08.824958 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:08.825755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.060122 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2490f01e-118c-46ee-aef9-8135d9b7c1a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.270313 Sep 25 01:02:09.069976 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 89/170] 10.222.0.26 () {60 vars in 1316 bytes} [Sun Sep 25 01:02:08 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-interface => generated 284 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:02:09.221073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:09.224334 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:09.239226 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.240669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.242849 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.244894 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.246147 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.248776 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.278852 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] HTTP exception thrown: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Request method failure captured: Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee HTTP/1.1 Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hEDNWE6KyYKklY_HnUI_t8Eh8KQ0D6o647OwQAc00PLB1OGkurR2701KFqaJIe5kaw5-J15iJ258xI7bjBOYgFzHUXS-iwHeFSRnOXR32Lv1L2Y0iM1tr-A5-oTy6Q-SKgUBA3Tge5fTOhOhATKNdrK6ygXOt5p_AkwRdV1EB_9rU Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:02:09.290946 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b369e7845314685b4145d3feaa02258", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b369e7845314685b4145d3feaa02258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}] Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: ef66ca98e383463994017e057c499c6f Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.293510 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '0a19adc9-f2ec-4759-8777-ea8dcafe17ee'} Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:09.294994 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.298360 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.303500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Returning 404 to user: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:09.306310 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62c96b8c-2985-479c-b695-798f4f4184ba tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 404 len: 111 microversion: 2.1 time: 0.102152 Sep 25 01:02:09.314195 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 82/171] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:09 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 111 bytes in 111 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:09.425398 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:09.429612 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:09.470605 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.477272 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.478247 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.482997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.488547 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.489374 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.630676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:09.635275 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:09.647342 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.649284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.650198 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.651366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:09.652148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:09.653044 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:09.674891 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] HTTP exception thrown: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Request method failure captured: Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee/os-volume_attachments HTTP/1.1 Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hEDNWE6KyYKklY_HnUI_t8Eh8KQ0D6o647OwQAc00PLB1OGkurR2701KFqaJIe5kaw5-J15iJ258xI7bjBOYgFzHUXS-iwHeFSRnOXR32Lv1L2Y0iM1tr-A5-oTy6Q-SKgUBA3Tge5fTOhOhATKNdrK6ygXOt5p_AkwRdV1EB_9rU Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:02:09.677190 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b369e7845314685b4145d3feaa02258", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b369e7845314685b4145d3feaa02258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}] Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: ef66ca98e383463994017e057c499c6f Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.678405 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'server_id': '0a19adc9-f2ec-4759-8777-ea8dcafe17ee'} Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:09.679610 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:09.680697 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:02:09.683340 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Returning 404 to user: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:09.684868 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5784dac8-5914-45ab-a47a-f1db00c0ae3b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.059598 Sep 25 01:02:09.685893 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 83/172] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:02:09 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee/os-volume_attachments => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:02:10.062276 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:10.089702 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1df8c701-5868-4ca8-9a1e-eb77cd1f8db0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.673488 Sep 25 01:02:10.139741 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 90/173] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:09 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:11.144169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.145168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:11.170134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.170688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.171184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.173724 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.176800 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.181854 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.275069 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.279085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:11.310316 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.313559 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.314596 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.317980 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.319130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.321071 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.367770 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] HTTP exception thrown: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Request method failure captured: Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: DELETE /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee HTTP/1.1 Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hEDNWE6KyYKklY_HnUI_t8Eh8KQ0D6o647OwQAc00PLB1OGkurR2701KFqaJIe5kaw5-J15iJ258xI7bjBOYgFzHUXS-iwHeFSRnOXR32Lv1L2Y0iM1tr-A5-oTy6Q-SKgUBA3Tge5fTOhOhATKNdrK6ygXOt5p_AkwRdV1EB_9rU Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:02:11.379666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b369e7845314685b4145d3feaa02258", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b369e7845314685b4145d3feaa02258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}] Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: ef66ca98e383463994017e057c499c6f Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.383588 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '0a19adc9-f2ec-4759-8777-ea8dcafe17ee'} Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:11.385125 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.387440 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.394578 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Returning 404 to user: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:11.397058 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5a679a28-41a6-48c1-8c38-0d4c8cd641d9 tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 404 len: 111 microversion: 2.1 time: 0.134787 Sep 25 01:02:11.398467 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 91/174] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:02:11 2022] DELETE /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 111 bytes in 138 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:02:11.435244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:11.436906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] [instance: 0a19adc9-f2ec-4759-8777-ea8dcafe17ee] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:11.451116 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.453614 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.454731 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.456275 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:11.457197 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:11.458131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:11.485139 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] HTTP exception thrown: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Request method failure captured: Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee HTTP/1.1 Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hEDNWE6KyYKklY_HnUI_t8Eh8KQ0D6o647OwQAc00PLB1OGkurR2701KFqaJIe5kaw5-J15iJ258xI7bjBOYgFzHUXS-iwHeFSRnOXR32Lv1L2Y0iM1tr-A5-oTy6Q-SKgUBA3Tge5fTOhOhATKNdrK6ygXOt5p_AkwRdV1EB_9rU Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:02:11.487586 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_0b369e7845314685b4145d3feaa02258", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/0b369e7845314685b4145d3feaa02258"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/0b369e7845314685b4145d3feaa02258"}]}] Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 0b369e7845314685b4145d3feaa02258 Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-DeleteServersTestJSON-2027736365 Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: ef66ca98e383463994017e057c499c6f Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-DeleteServersTestJSON-2027736365-project Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.489092 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '0a19adc9-f2ec-4759-8777-ea8dcafe17ee'} Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:02:11.490147 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. Sep 25 01:02:11.493158 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:02:11.497815 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] Returning 404 to user: Instance 0a19adc9-f2ec-4759-8777-ea8dcafe17ee could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:02:11.498952 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5d98b4d1-92b6-4dd7-89f0-a6fe8435db5b tempest-DeleteServersTestJSON-2027736365 tempest-DeleteServersTestJSON-2027736365-project] 10.222.0.26 "GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee" status: 404 len: 111 microversion: 2.1 time: 0.094644 Sep 25 01:02:11.500314 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 92/175] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:11 2022] GET /compute/v2.1/servers/0a19adc9-f2ec-4759-8777-ea8dcafe17ee => generated 111 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:02:11.732784 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:11.755156 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ae12e23e-0c3c-47ff-ac55-e95a9d9049f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.619237 Sep 25 01:02:11.758479 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 84/176] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:11 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:12.799069 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:12.800516 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:12.828143 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:12.829253 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:12.832122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:12.838336 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:12.838945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:12.839595 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:13.581939 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:13.613054 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-de79bf37-91e6-4162-a70f-d5e16ea18053 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.819292 Sep 25 01:02:13.616106 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 93/177] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:12 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 823 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:13.625987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-42b23af2-72b9-49de-be66-cfb4e4cc73a9 req-813154b0-6502-4bd8-a418-9314ce0128f5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e3594bb0-3667-44b5-badd-3dcfe8b74c27", "tag": "8914da89-09c9-40c1-90d8-87e916c3a872"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:13.698998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-42b23af2-72b9-49de-be66-cfb4e4cc73a9 req-813154b0-6502-4bd8-a418-9314ce0128f5 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:13.706729 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-42b23af2-72b9-49de-be66-cfb4e4cc73a9 req-813154b0-6502-4bd8-a418-9314ce0128f5 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:13.708035 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-42b23af2-72b9-49de-be66-cfb4e4cc73a9 req-813154b0-6502-4bd8-a418-9314ce0128f5 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:13.741152 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-42b23af2-72b9-49de-be66-cfb4e4cc73a9 req-813154b0-6502-4bd8-a418-9314ce0128f5 service nova] Creating event network-changed:8914da89-09c9-40c1-90d8-87e916c3a872 for instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 on hv-cinder-maste Sep 25 01:02:13.756224 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-42b23af2-72b9-49de-be66-cfb4e4cc73a9 req-813154b0-6502-4bd8-a418-9314ce0128f5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.139747 Sep 25 01:02:13.758675 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 85/178] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:14.667052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:14.669322 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:14.695774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.701855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.702766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:14.706891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:14.707739 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:14.714085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:15.134320 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:15.152414 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ec8d8db5-853d-47ea-b5d4-fa6a1665101f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.497603 Sep 25 01:02:15.155275 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 94/179] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:14 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:16.187929 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:16.191744 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:16.210985 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:16.217085 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:16.217520 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:16.218572 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:16.219818 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:16.220890 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:17.020273 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:17.041277 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-32032ac0-da12-4b69-8843-29e4cccacdd4 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.863499 Sep 25 01:02:17.047259 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 86/180] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:16 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 872 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:18.076131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:18.077668 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:18.107194 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.112262 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.114439 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.121639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:18.122196 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:18.125105 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:18.756605 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:18.783954 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8c9d5780-afc0-45c3-9c3c-7b4747d7d176 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.716972 Sep 25 01:02:18.786479 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 95/181] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:18 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 721 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:19.832700 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:19.835587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:19.852232 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.855898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.856405 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:19.859953 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:19.861367 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:19.863580 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:20.419323 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:20.447682 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-55affffc-4979-40d8-af8b-2c8443c6e36d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.628513 Sep 25 01:02:20.455581 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 87/182] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:19 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:21.482127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:21.488066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:21.520802 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:21.521526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:21.522047 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:21.523727 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:21.547082 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:21.548098 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:22.153211 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:22.189708 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-efe76c78-4605-484b-9d28-093889f69fe7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.710395 Sep 25 01:02:22.194964 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 96/183] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:21 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 724 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:23.227259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:23.227921 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:23.235277 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.236477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.237089 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.238114 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:23.238793 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:23.239417 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:23.553226 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:23.573113 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f380a590-8985-4a84-aee0-d0de50dd197f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.344752 Sep 25 01:02:23.578694 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 88/184] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:23 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:24.597467 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:24.601062 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:24.628225 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.630918 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.633548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.635322 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:24.636786 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:24.638437 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:24.996895 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:25.021535 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0e60dc31-d584-45b0-8814-47a7037a8c3a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.426898 Sep 25 01:02:25.021535 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 97/185] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:24 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:26.065110 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:26.066228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:26.095583 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.096472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.097266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.098584 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:26.099443 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:26.101279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:26.377145 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:26.409543 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f42368aa-e24a-4b47-842c-5e17651a00e3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.343365 Sep 25 01:02:26.409543 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 89/186] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:26 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:27.453489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:27.456346 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:27.474717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:27.479141 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:27.483398 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:27.485025 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:27.488563 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:27.491177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:27.493811 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:27.890396 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:27.923792 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ab7bb399-4587-4bf2-b044-692f0624019d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.481317 Sep 25 01:02:27.930456 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 98/187] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:27 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:28.959187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:28.960549 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:28.978107 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.980699 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.984787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:28.989456 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:28.990340 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:28.991119 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:29.103987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:29.763816 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:29.790327 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7b576af0-78db-44c8-948e-2e6ae6715e0b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.836230 Sep 25 01:02:29.793278 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 90/188] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:28 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 843 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:30.846188 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:30.851204 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:30.899456 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:30.900025 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:30.900829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:30.902149 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:30.912409 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:30.915752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:31.387940 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:31.401550 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-cec51353-df20-4e32-96d2-5294df0abff8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.565319 Sep 25 01:02:31.402841 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 99/189] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:30 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 568 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:32.443059 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:32.446188 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:32.459316 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=42 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:32.465350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:32.466563 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:32.467972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:32.471318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:32.472360 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:32.473366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:32.753402 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:32.766835 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-682af5b4-8dcb-48e0-94f4-30973769d81c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.331019 Sep 25 01:02:32.767775 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 91/190] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:32 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:33.836020 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:33.837244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:33.902135 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:33.916221 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:33.916987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:33.923067 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:33.924268 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:33.932779 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:34.711276 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:34.732822 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b6acfd57-5207-4da5-a638-fc5780eac0f1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.929538 Sep 25 01:02:34.737876 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 100/191] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:33 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 940 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:35.773678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:35.778427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:35.826251 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.828041 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.829812 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:35.833649 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:35.835548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:35.836927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:36.645910 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:36.711028 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a9eb0ff7-8f81-4771-bbbc-fe089fb58e6b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.947712 Sep 25 01:02:36.716509 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 92/192] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:35 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 955 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:36.957398 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6bbd59cd-8fda-433b-96d4-740a60ada05a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: .version_select at 0x7f11815d4af0>, body: {"keypair": {"name": "tempest-keypair-524404470", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOfOhew7Pu3mkduvjxOnPC/Q/R7FisHSo09gSDn12dmiXSihL0PZDyG26YX36goIVe3RBnD04Cz6fSK3kf2YQBFQ0dj+Adf9WiOzw7C3y7fwPl6iq9YVQxRIFp3e2TBWVw=="}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:37.002767 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-6bbd59cd-8fda-433b-96d4-740a60ada05a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:37.008619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-6bbd59cd-8fda-433b-96d4-740a60ada05a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:37.067548 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6bbd59cd-8fda-433b-96d4-740a60ada05a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.905287 Sep 25 01:02:37.079985 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 101/193] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:02:36 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:02:37.759826 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:37.760512 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:37.779482 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.782996 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.787214 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:37.789172 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:37.789700 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:37.790155 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:38.529632 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:38.546817 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b70b4959-e006-4833-9139-daeda15e53e8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1522 microversion: 2.1 time: 0.791692 Sep 25 01:02:38.548781 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 93/194] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:37 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1522 bytes in 794 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:39.580115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:39.581047 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:39.599339 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.603626 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.604857 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.606687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:39.608015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:39.609787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:39.702584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=90 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:40.062579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.077696 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c1717a91-a983-40fd-b566-28ec3640b97d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1502 microversion: 2.1 time: 0.508301 Sep 25 01:02:40.087246 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 102/195] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:39 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1502 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:40.114293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:40.115244 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:40.136316 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.136874 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.137341 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.138205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:40.138816 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:40.139310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:40.928091 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:40.945794 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b08f5c32-67c5-4f78-9e0c-61c116340ebf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1515 microversion: 2.1 time: 0.835448 Sep 25 01:02:40.946884 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 94/196] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:40 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1515 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:42.402231 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1187637829", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b"}], "security_groups": [{"name": "tempest-securitygroup--505478969"}], "key_name": "tempest-keypair-524404470", "user_data": "}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:42.767792 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] validate_networks() for [('3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:42.800618 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:42.805693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:42.840236 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.852542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.853422 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.854788 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:42.855641 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:42.856471 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:42.950831 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'flavor' on Instance uuid d51dd9a7-b187-4c50-a7e5-380a2f8356f6 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:02:43.342596 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-66e74a75-2808-45a3-abd8-ab2b077462e6 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6/action" status: 200 len: 32 microversion: 2.1 time: 0.555074 Sep 25 01:02:43.348864 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 95/197] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:02:42 2022] POST /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6/action => generated 32 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:02:43.362492 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:43.368181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:43.376719 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.377295 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.378210 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:43.380052 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.380840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.381535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:43.889846 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:43.891136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:43.891632 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:43.892148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:43.892626 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:43.914501 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:43.922342 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.939830 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.941607 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.017s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:43.945223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:43.947689 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:43.951676 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:43.979637 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-06337418-4c40-434d-b00b-1edbbf5c2831 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.626799 Sep 25 01:02:43.981258 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 96/198] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:43 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 632 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:44.048436 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:44.095015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:44.155662 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:44.174736 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:44.370165 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1f019343-8566-4248-8fec-9b23851ad6b1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.991949 Sep 25 01:02:44.371143 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 103/199] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:42 2022] POST /compute/v2.1/servers => generated 401 bytes in 1994 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:02:44.389896 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f2295024-be7c-45b7-82d1-c08a6845f230 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:44.397712 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f2295024-be7c-45b7-82d1-c08a6845f230 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:44.833935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-454137401", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "networks": [{"uuid": "84c2657c-a215-4c98-b766-afc28d2d4bc3"}]}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:44.858518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f2295024-be7c-45b7-82d1-c08a6845f230 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:44.908809 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f2295024-be7c-45b7-82d1-c08a6845f230 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1241 microversion: 2.1 time: 0.521044 Sep 25 01:02:44.910915 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 97/200] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:44 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1241 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:45.021430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] validate_networks() for [('84c2657c-a215-4c98-b766-afc28d2d4bc3', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:02:45.044357 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:45.054085 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:45.099802 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.102647 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.106493 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.110856 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:45.115530 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:45.118964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:45.983167 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:02:45.983939 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:02:45.984873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:02:45.986035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:02:45.986940 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:02:46.009017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.009920 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.010759 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.014789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.016022 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.016905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.022163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:46.050616 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-044dc880-da1c-4aea-b2a5-3a41714ce11c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 1.026967 Sep 25 01:02:46.053749 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 98/201] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:45 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 1032 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:46.064854 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:46.071311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:46.096182 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.096637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Getting quotas for project f53d77003a86430b93638b729930f788. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:02:46.097559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.098539 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.101298 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:46.102444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:46.104258 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:46.113423 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Getting quotas for user 2413fa59e75741a68f391e55a8a7dc2e and project f53d77003a86430b93638b729930f788. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:02:46.153812 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:02:46.158988 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:02:46.286693 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8275f2db-2243-4d8e-a000-c062f57a02b0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.462765 Sep 25 01:02:46.296817 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 104/202] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:02:44 2022] POST /compute/v2.1/servers => generated 380 bytes in 1466 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:02:46.329714 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f77c65c9-f754-4bda-85fc-2f6fd138df91 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:46.333907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f77c65c9-f754-4bda-85fc-2f6fd138df91 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:46.456558 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f77c65c9-f754-4bda-85fc-2f6fd138df91 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:46.493536 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f77c65c9-f754-4bda-85fc-2f6fd138df91 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1218 microversion: 2.1 time: 0.194195 Sep 25 01:02:46.494865 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 105/203] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:46 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1218 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:46.508674 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:46.531390 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-eafd00e7-4d87-4b84-aa69-70652706048f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1293 microversion: 2.1 time: 0.474473 Sep 25 01:02:46.551695 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 99/204] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:46 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1293 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:47.098947 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:47.100106 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:47.137234 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.138612 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.149743 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.151172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.151982 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.152821 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.388098 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:47.402504 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a6f4f937-2826-4445-8e6d-c559859f359e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.311852 Sep 25 01:02:47.418532 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 106/205] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:47 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:47.546625 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:47.551524 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:47.577838 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.578085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:47.578911 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.579111 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:47.579744 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.580775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.581502 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.582169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.598206 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.607149 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.607942 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.627149 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:47.629395 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:47.633934 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:47.752119 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:47.768944 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-24639717-c5c2-4fa4-898d-8c0cf39b486e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1214 microversion: 2.1 time: 0.229969 Sep 25 01:02:47.770779 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 100/206] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:47 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1214 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:47.829158 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:47.841989 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8ce64be9-d231-4170-959f-b8c36a4c7312 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1299 microversion: 2.1 time: 0.277111 Sep 25 01:02:47.853563 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 107/207] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:47 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1299 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:48.449939 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:48.450631 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:48.458012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.458513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.459138 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.460778 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.461243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.461668 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.682597 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:48.690987 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-00486ada-44a6-4ebd-9682-63e5a6fc5c4c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.254218 Sep 25 01:02:48.704896 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 101/208] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:48 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:48.817778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:48.819058 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:48.831821 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.834796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.836611 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.839572 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.840402 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.841142 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.886566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:48.889358 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:48.902717 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.911911 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.915343 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:48.916480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:48.922243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:48.923274 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:49.048185 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:49.058850 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-dec25480-a6f7-49d5-8454-fc7561303fd5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1270 microversion: 2.1 time: 0.243148 Sep 25 01:02:49.063969 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 108/209] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:48 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1270 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:49.586381 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:49.604729 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-298dfc40-49a7-4277-8558-6d1fc5609179 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.724446 Sep 25 01:02:49.605768 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 102/210] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:48 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 727 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:49.717117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:49.718121 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:49.728945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:49.729839 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:49.731636 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:49.733044 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:49.733714 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:49.734567 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.015816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:50.063643 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-372940f9-8088-4ff0-96ea-ba6f9e207a8a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.349536 Sep 25 01:02:50.065635 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 109/211] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:49 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:50.092232 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:50.093704 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:50.102943 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.106417 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.107325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.108783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.110017 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.111043 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.251247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:50.290737 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fcdb544e-f649-49d7-9402-1a294f001fda tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1276 microversion: 2.1 time: 0.200058 Sep 25 01:02:50.290737 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 103/212] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:50 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1276 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:50.632225 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:50.633201 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:50.644904 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.645415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.645901 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.646701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.647167 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.647685 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.764651 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-19cd21cc-eb1a-42a7-810b-a4f4104c8cb0 req-09765839-ce0c-4b15-a847-7a560d0b5920 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9d047b-1796-4f02-96c1-94e475e3b55e", "tag": "b1424cc3-3df2-4c19-aeff-7dd43651ddad"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:50.814236 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-19cd21cc-eb1a-42a7-810b-a4f4104c8cb0 req-09765839-ce0c-4b15-a847-7a560d0b5920 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:50.815335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-19cd21cc-eb1a-42a7-810b-a4f4104c8cb0 req-09765839-ce0c-4b15-a847-7a560d0b5920 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:50.816374 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-19cd21cc-eb1a-42a7-810b-a4f4104c8cb0 req-09765839-ce0c-4b15-a847-7a560d0b5920 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:50.852134 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-19cd21cc-eb1a-42a7-810b-a4f4104c8cb0 req-09765839-ce0c-4b15-a847-7a560d0b5920 service nova] Creating event network-changed:b1424cc3-3df2-4c19-aeff-7dd43651ddad for instance 7d9d047b-1796-4f02-96c1-94e475e3b55e on hv-cinder-maste Sep 25 01:02:50.863485 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-19cd21cc-eb1a-42a7-810b-a4f4104c8cb0 req-09765839-ce0c-4b15-a847-7a560d0b5920 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.107611 Sep 25 01:02:50.866836 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 104/213] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:51.008587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:51.025485 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c2372928-20ad-4a3c-a46c-3f0ef77d0700 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.397596 Sep 25 01:02:51.041778 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 110/214] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:50 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:51.095519 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:51.099259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:51.120005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.125320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.126467 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.128038 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.129147 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.131591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.321118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:51.321840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:51.332731 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.333221 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.333669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.334405 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:51.335012 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:51.335427 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:51.665171 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:51.666767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:51.682978 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a8188dbb-4237-4171-be24-17f58463947b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.367750 Sep 25 01:02:51.684100 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 111/215] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:51 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:51.696712 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-509b6b83-8fc1-4955-b810-269d92a22aa7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.598027 Sep 25 01:02:51.696712 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 105/216] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:51 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:52.071504 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:52.073310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:52.120636 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.121463 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.121921 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.126536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.127536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.128309 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.474318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:52.483250 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:52.533493 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-81716463-4a1e-4534-b8d0-b15bdbc28b70 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.470747 Sep 25 01:02:52.537053 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 106/217] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:52 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:52.723176 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:52.723702 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:52.724301 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:52.726837 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:52.738040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.738574 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.742474 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.745711 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.746376 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.746501 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.747124 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.748448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.749264 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:52.760833 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:52.762222 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:52.762670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.063785 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:53.074275 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c01fd77f-9036-4201-9746-00bf9d6a23a8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.361423 Sep 25 01:02:53.076640 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 112/218] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:52 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:53.158949 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:53.169669 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5024cc4c-a65d-4227-8ba6-e4eee2f24231 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.451272 Sep 25 01:02:53.185937 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 107/219] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:52 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:53.229526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-a59699f0-405e-499c-893b-69b1d1bdabb5 req-71047ff3-30a3-41e4-a01d-474b8ca33835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "070f3413-b82a-4579-a63e-c27393bca164", "tag": "55055f5c-0786-4020-95fd-cc8119259b63"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:02:53.245169 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-a59699f0-405e-499c-893b-69b1d1bdabb5 req-71047ff3-30a3-41e4-a01d-474b8ca33835 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.246451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-a59699f0-405e-499c-893b-69b1d1bdabb5 req-71047ff3-30a3-41e4-a01d-474b8ca33835 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.247355 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-a59699f0-405e-499c-893b-69b1d1bdabb5 req-71047ff3-30a3-41e4-a01d-474b8ca33835 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.265808 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-a59699f0-405e-499c-893b-69b1d1bdabb5 req-71047ff3-30a3-41e4-a01d-474b8ca33835 service nova] Creating event network-changed:55055f5c-0786-4020-95fd-cc8119259b63 for instance 070f3413-b82a-4579-a63e-c27393bca164 on hv-cinder-maste Sep 25 01:02:53.271860 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-a59699f0-405e-499c-893b-69b1d1bdabb5 req-71047ff3-30a3-41e4-a01d-474b8ca33835 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047444 Sep 25 01:02:53.273596 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 113/220] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:02:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:02:53.566547 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:53.567135 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:53.579202 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.580561 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.581602 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.583220 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:53.584355 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:53.585505 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:53.854177 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:53.873442 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f1e4cb36-cbdd-4f58-bae4-5f2eb1348da5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.310301 Sep 25 01:02:53.875236 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 108/221] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:53 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:54.135803 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.143462 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:54.170660 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.175860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.176324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.178259 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.182122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.182879 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.210633 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.213739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:54.227321 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.228125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.229016 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.230059 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.231375 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.232915 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.504724 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:54.527362 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-43c1840f-4966-478f-affa-604a65c8859b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.325592 Sep 25 01:02:54.545115 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 109/222] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:54.564937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:54.588260 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f5904ff0-0d62-4eeb-9ca6-1f4c14871aa5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.474704 Sep 25 01:02:54.605698 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 114/223] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:54.914678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:54.924909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:54.936598 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:54.949046 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.950654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.951859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:54.953595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:54.954847 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:54.956861 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:55.567050 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:55.568335 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:55.587244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:55.588061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:55.588723 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:55.589731 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:55.598469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:55.599648 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:56.041288 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=4 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:56.078322 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:56.078975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:56.092923 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8b349a2b-730b-4881-b4ad-444c36a7870f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 1.183863 Sep 25 01:02:56.106476 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 110/224] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:54 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 1201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:56.109005 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-88a1b9ff-7ed4-4c23-a06f-28834e3c29a4 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.547052 Sep 25 01:02:56.113538 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 115/225] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:55 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:56.114030 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:56.114655 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:56.131406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:56.132808 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:56.133756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:56.134763 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:56.135484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:56.136213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:56.683228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:56.734700 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bcc8502b-2397-4130-9347-0d7efdd3391b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.619804 Sep 25 01:02:56.753181 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 111/226] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:56 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 646 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:57.126093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:57.127722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:57.140097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=18 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:57.145594 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.147356 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:57.148545 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:57.153653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.155146 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.157037 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.157294 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.157945 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.158702 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.159265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.159598 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.160074 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.160535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.161107 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.464044 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:57.473131 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-04378ba6-a15c-4857-b2d8-3b86bb793f93 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.330558 Sep 25 01:02:57.474413 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 112/227] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:57 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:57.561445 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:57.574456 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c1cfa1fc-4399-4958-9bfe-36158b75685e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.454957 Sep 25 01:02:57.575762 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 116/228] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:57 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:57.787040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:57.787925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:57.797324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.798021 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.798883 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:57.799977 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:57.800688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:57.801279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.218598 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:58.228429 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-916f6a8f-24d0-46de-b778-401c28b89f3c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.446378 Sep 25 01:02:58.229560 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 113/229] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:57 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:58.519370 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:58.520807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:58.524033 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=7 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:02:58.530248 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.531060 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.531667 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.532597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.533483 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.534128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.635063 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:58.636672 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:58.652977 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.654291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.655315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.656951 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:58.660126 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:58.661609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:58.751019 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:58.769115 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-11060eaf-6f83-4b44-887b-437f1b0907ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.253061 Sep 25 01:02:58.785176 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 117/230] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:58 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:02:58.977785 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:58.999374 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d890773b-4ef3-4d7d-bdf4-6d2be7de2e8d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.375327 Sep 25 01:02:59.018712 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 114/231] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:58 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:59.258604 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:59.260941 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:59.275803 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.276716 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.277863 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.279528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.281284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.283779 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.503722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:02:59.517061 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5e213cda-6812-419d-b784-9227044edb86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.266064 Sep 25 01:02:59.520443 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 118/232] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:59 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:02:59.816231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:02:59.818347 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:02:59.828781 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.829670 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.830376 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:02:59.831787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:02:59.832533 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:02:59.833207 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.045034 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:00.046357 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:00.056992 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.058096 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.058992 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.060210 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.061123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.062189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.212650 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:00.241094 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-880ea4a6-a766-4be7-8bbd-9b60bf55e977 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.431950 Sep 25 01:03:00.242104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:00.252194 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1453097a-9799-42c0-abb7-049be33cf1d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.212312 Sep 25 01:03:00.264409 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 115/233] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:02:59 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:00.275645 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 119/234] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:00 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:00.375210 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ae032ddd-3104-4926-af49-27549129f0fe req-87e67291-eac6-49ad-99a9-5f40f3429a96 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9d047b-1796-4f02-96c1-94e475e3b55e", "name": "network-vif-plugged", "status": "completed", "tag": "b1424cc3-3df2-4c19-aeff-7dd43651ddad"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:00.390360 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ae032ddd-3104-4926-af49-27549129f0fe req-87e67291-eac6-49ad-99a9-5f40f3429a96 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.390956 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ae032ddd-3104-4926-af49-27549129f0fe req-87e67291-eac6-49ad-99a9-5f40f3429a96 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.391365 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ae032ddd-3104-4926-af49-27549129f0fe req-87e67291-eac6-49ad-99a9-5f40f3429a96 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.415703 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ae032ddd-3104-4926-af49-27549129f0fe req-87e67291-eac6-49ad-99a9-5f40f3429a96 service nova] Creating event network-vif-plugged:b1424cc3-3df2-4c19-aeff-7dd43651ddad for instance 7d9d047b-1796-4f02-96c1-94e475e3b55e on hv-cinder-maste Sep 25 01:03:00.423413 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ae032ddd-3104-4926-af49-27549129f0fe req-87e67291-eac6-49ad-99a9-5f40f3429a96 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052162 Sep 25 01:03:00.425092 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 116/235] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:00.551474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:00.552727 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:00.566260 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.567163 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.569145 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.579261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:00.580415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:00.581494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:00.785093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:00.802279 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-220db581-34d9-4062-8bd1-fe82ecc6528f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.259902 Sep 25 01:03:00.821517 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 120/236] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:00 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:01.280627 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:01.281443 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:01.284230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:01.289187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.289671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.290350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.290738 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:01.291379 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.291840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.292265 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.314059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.315115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.315945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.317352 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.318410 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.319018 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.608867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:01.615864 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:01.622507 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0e28f710-a0ed-4523-bbbe-362fd7579ab8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.346700 Sep 25 01:03:01.623341 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:01.634978 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-22a23a30-25d8-45ee-a7a7-1062b4ec598e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.357698 Sep 25 01:03:01.644442 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 117/237] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:01 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:01.644653 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 121/238] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:01 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:01.843891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:01.845062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:01.853867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.854813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.855526 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:01.857260 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:01.858206 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:01.858871 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.287648 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:02.299727 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-496d2e31-f45a-4c7a-9c39-8b9baf457237 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.462208 Sep 25 01:03:02.300434 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 118/239] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:01 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:02.655739 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:02.659139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:02.660300 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:02.661018 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:02.664936 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=58 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:02.677820 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.679376 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.680071 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.681643 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.682310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.682903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.694539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.697033 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.698656 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.701228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:02.703784 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:02.704908 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:02.929234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:02.938493 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d0ca6549-abc9-4f88-9ee6-7a602b2a83f8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.283436 Sep 25 01:03:02.939092 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 119/240] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:02 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:02.966536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:02.977497 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1edb51ff-9887-4922-997c-1bf42db2d120 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.331039 Sep 25 01:03:02.978362 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 122/241] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:02 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:03.348690 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:03.349980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:03.367390 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.368263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.371158 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.372266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.372979 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.374775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.644159 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:03.654967 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c716482a-af46-433a-b7af-3bf68412c030 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.322545 Sep 25 01:03:03.655744 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 120/242] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:03 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:03.972959 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:03.975921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:03.990126 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.990915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.991904 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:03.993524 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:03.994353 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:03.995255 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:04.019510 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:04.020607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:04.033247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:04.034399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:04.035186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:04.043118 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:04.044285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:04.050868 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:04.377266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:04.394607 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1c68cada-70bc-4ba7-a241-ee0cbbfff901 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.434690 Sep 25 01:03:04.396013 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 123/243] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:03 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:04.450238 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:04.477642 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-f9245693-a89c-439b-a3d1-3d9deb388067 req-3c7978e8-de54-4a37-b682-36dabc158572 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070f3413-b82a-4579-a63e-c27393bca164", "name": "network-vif-plugged", "status": "completed", "tag": "55055f5c-0786-4020-95fd-cc8119259b63"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:04.478990 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a4dbc60f-add9-494c-9702-063e64bb5212 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.465224 Sep 25 01:03:04.482595 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 121/244] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:04 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:04.503031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f9245693-a89c-439b-a3d1-3d9deb388067 req-3c7978e8-de54-4a37-b682-36dabc158572 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:04.504260 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f9245693-a89c-439b-a3d1-3d9deb388067 req-3c7978e8-de54-4a37-b682-36dabc158572 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:04.505326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f9245693-a89c-439b-a3d1-3d9deb388067 req-3c7978e8-de54-4a37-b682-36dabc158572 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:04.532913 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-f9245693-a89c-439b-a3d1-3d9deb388067 req-3c7978e8-de54-4a37-b682-36dabc158572 service nova] Creating event network-vif-plugged:55055f5c-0786-4020-95fd-cc8119259b63 for instance 070f3413-b82a-4579-a63e-c27393bca164 on hv-cinder-maste Sep 25 01:03:04.544861 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-f9245693-a89c-439b-a3d1-3d9deb388067 req-3c7978e8-de54-4a37-b682-36dabc158572 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073974 Sep 25 01:03:04.547154 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 124/245] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:04.714764 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:04.718665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:04.745731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:04.747335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:04.752710 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:04.755736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:04.757553 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:04.758870 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.070150 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:05.079908 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4f647628-6fa3-4111-8bc6-0d3def546450 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1501 microversion: 2.1 time: 0.384485 Sep 25 01:03:05.081361 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 122/246] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:04 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1501 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:05.123869 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8b2950c0-43a7-4695-a97e-e381d739cdcb"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:05.128542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:05.155682 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.156873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.157796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.159567 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.160670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.161666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.215503 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] HTTP exception thrown: Cannot 'attach_volume' instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 while it is in vm_state rescued Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Request method failure captured: Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: POST /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6/os-volume_attachments HTTP/1.1 Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 74 Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hKYF4_JwUcbTnW4oRzcy7qEP1dfTBC03wPczp6YeO0UWOgoDHfENsdVRYOxxBcqqOO0s8JXTrZhsw4D9VYMLmNQ7prt1YpRIiMWnbMRoU0pYX2RRAKjC6oQTg0-iMuzBG-yzx2btCP21DnX3Vo36OLBB_Ok4iLN8V_gchQjZhG2kc Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:03:05.219121 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5b11c2ffde89471cafaf35f8579e3ab2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}] Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: ca20e105b76149dd99e4aa64c62eb483 Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: {"volumeAttachment": {"volumeId": "8b2950c0-43a7-4695-a97e-e381d739cdcb"}} Sep 25 01:03:05.221844 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Cannot 'attach_volume' instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 while it is in vm_state rescued Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'server_id': 'd51dd9a7-b187-4c50-a7e5-380a2f8356f6', 'body': {'volumeAttachment': {'volumeId': '8b2950c0-43a7-4695-a97e-e381d739cdcb'}}} Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:03:05.223386 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 while it is in vm_state rescued Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:03:05.226123 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:03:05.228294 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:03:05.228294 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:03:05.228294 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 while it is in vm_state rescued Sep 25 01:03:05.228294 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:03:05.231649 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Returning 409 to user: Cannot 'attach_volume' instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 while it is in vm_state rescued {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:03:05.234551 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-11ea3b95-5f82-462a-b620-81ede44e7a17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.119420 Sep 25 01:03:05.244496 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 125/247] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:03:05 2022] POST /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6/os-volume_attachments => generated 152 bytes in 130 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:03:05.255382 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:05.256998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:05.273635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.275262 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.276492 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.278169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.279382 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.280639 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.433276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:05.448912 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:05.450029 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:05.461779 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.463168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.464280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.466031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.467239 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.468336 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.585543 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fc642ab5-47a9-4ec1-9e9e-c7556ac78507 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6/action" status: 202 len: 0 microversion: 2.1 time: 0.337083 Sep 25 01:03:05.591348 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 123/248] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:05 2022] POST /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6/action => generated 0 bytes in 343 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:03:05.602903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:05.604527 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:05.630267 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.630267 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.631290 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.633369 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.635158 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.635438 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.766115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:05.779308 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-285041a5-9cf3-4361-a2cd-6d6c8e1275ab tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1366 microversion: 2.1 time: 0.340116 Sep 25 01:03:05.780310 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 126/249] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:05 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:05.790307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:05.791351 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:05.814387 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.815030 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.815581 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:05.817527 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:05.821390 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:05.822246 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:06.127609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:06.145924 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-15d5eaea-c91d-449f-9062-1fa8d8d9189f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1509 microversion: 2.1 time: 0.363622 Sep 25 01:03:06.161992 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 127/250] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:05 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1509 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:06.243784 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:06.265050 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b123ec26-fc84-4a68-85d7-dacad3c59748 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.670845 Sep 25 01:03:06.268156 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 124/251] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:05 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:06.822633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:06.823637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:06.833018 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:06.841956 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:06.842839 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:06.843917 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:06.844697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:06.845368 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.133856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:07.158449 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4e0af8a6-8731-4ab9-a1e7-1f49c25b1a25 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1556 microversion: 2.1 time: 0.341628 Sep 25 01:03:07.160557 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 128/252] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:06 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1556 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:07.181266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:07.182126 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:07.196583 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.198248 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.201136 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.202177 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.202819 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.205863 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:07.207252 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:07.207468 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.219523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.220827 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.221913 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.223697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.224735 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.228717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.468926 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-958166c9-036a-4c25-85b2-836af6f8c83c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.271929 Sep 25 01:03:07.470071 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 129/253] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:03:07 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-interface => generated 285 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:07.498045 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:07.517070 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:07.556301 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.557480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.558542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.560142 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:07.569730 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:07.577199 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:07.766002 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:07.776877 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-28d138e7-67ee-4738-a637-9b825289d92a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1509 microversion: 2.1 time: 0.599616 Sep 25 01:03:07.778098 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 125/254] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:07 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1509 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:08.096059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:08.108219 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9f199748-b48e-45d7-9fec-8b38f8db41b7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1318 microversion: 2.1 time: 0.622187 Sep 25 01:03:08.109350 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 130/255] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:07 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1318 bytes in 639 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:08.837789 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:08.839702 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:08.857805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.859243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.861285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:08.862363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:08.863136 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:08.863843 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.146263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:09.146585 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:09.147655 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:09.164248 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c08b1843-d052-423a-a7d9-bd0ca53d1e17 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1509 microversion: 2.1 time: 0.331228 Sep 25 01:03:09.166155 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 126/256] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:08 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1509 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:09.168918 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.170047 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.171698 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.173189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:09.174150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:09.175060 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:09.776157 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:09.794126 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-19bddfc6-20e4-4ef0-a849-219b5255aa60 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1507 microversion: 2.1 time: 0.661814 Sep 25 01:03:09.795369 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 131/257] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:09 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1507 bytes in 664 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:10.140132 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-0a6cccfd-0130-44f7-a143-f8ca2c4fd63e req-435986e8-3b7d-4b64-8f7c-7a278a6b7a05 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7d9d047b-1796-4f02-96c1-94e475e3b55e", "tag": "b1424cc3-3df2-4c19-aeff-7dd43651ddad"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:10.192898 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:10.193749 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:10.198276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a6cccfd-0130-44f7-a143-f8ca2c4fd63e req-435986e8-3b7d-4b64-8f7c-7a278a6b7a05 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.200695 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a6cccfd-0130-44f7-a143-f8ca2c4fd63e req-435986e8-3b7d-4b64-8f7c-7a278a6b7a05 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.201577 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a6cccfd-0130-44f7-a143-f8ca2c4fd63e req-435986e8-3b7d-4b64-8f7c-7a278a6b7a05 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.207651 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.211985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.212948 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.213923 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:10.220140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:10.220987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:10.232544 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-0a6cccfd-0130-44f7-a143-f8ca2c4fd63e req-435986e8-3b7d-4b64-8f7c-7a278a6b7a05 service nova] Creating event network-changed:b1424cc3-3df2-4c19-aeff-7dd43651ddad for instance 7d9d047b-1796-4f02-96c1-94e475e3b55e on hv-cinder-maste Sep 25 01:03:10.250163 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-0a6cccfd-0130-44f7-a143-f8ca2c4fd63e req-435986e8-3b7d-4b64-8f7c-7a278a6b7a05 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112087 Sep 25 01:03:10.255081 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 127/258] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:10.544458 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:10.579754 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0afe7f49-44a4-4d39-820c-88d6dec03c94 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1509 microversion: 2.1 time: 0.390979 Sep 25 01:03:10.583569 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 132/259] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:10 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1509 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:11.616937 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:11.618445 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:11.643740 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.644581 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.645283 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.646478 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:11.647232 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:11.647979 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:11.986039 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:12.013921 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-71e03f04-4b41-4524-9303-fca1a1990690 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1509 microversion: 2.1 time: 0.409189 Sep 25 01:03:12.018162 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 128/260] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:11 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1509 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:13.046249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:13.047579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:13.060918 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:13.061584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:13.062295 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:13.063266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:13.064664 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:13.071415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:13.374761 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:13.384318 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-463e61d5-c5e3-4a35-9f23-f8f573f20f86 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1515 microversion: 2.1 time: 0.343005 Sep 25 01:03:13.385376 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 133/261] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:13 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1515 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:15.206253 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ff7749bf-fcb3-42ea-953f-2b09718babcc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'create', calling method: .version_select at 0x7f11816ae1f0>, body: {"keypair": {"name": "tempest-keypair-2077848609", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNwRVhlOCkGuTB/dMF812yqvCMtJM2+sbjZY5u9dSyE5kb0tg2R9T8FacJ2cDeZy+3n1EZG5rtk6oe6WxZS7GxaBdpbJrYdBal29pGbbx1DJCLM5ZYA+Z7DjauulHrAzMw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:15.232513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-ff7749bf-fcb3-42ea-953f-2b09718babcc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:15.237427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-ff7749bf-fcb3-42ea-953f-2b09718babcc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for user ca20e105b76149dd99e4aa64c62eb483 and project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:15.295652 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ff7749bf-fcb3-42ea-953f-2b09718babcc tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.093148 Sep 25 01:03:15.307250 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 129/262] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:03:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:16.927703 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b0d0456f-cf23-47ec-a661-50696a9b07e2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Action: 'create', calling method: .version_select at 0x7f11815b89d0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1204173063", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPpeXHmLwOKWXZlLcAi47TufMCTPKQJE3f0JgFU4DIiEapLzd+NcEJlgFalUK0bPKeGYzuh20jFgJf1aMWfYwTBBdl2pLUhky87FOh9OanY83HfD3NQv/MGI1JdIW+bnVA=="}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:16.947235 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-b0d0456f-cf23-47ec-a661-50696a9b07e2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Getting quotas for project a49eb5e19c0e44b3b9273f5126c0915f. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:16.952324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-b0d0456f-cf23-47ec-a661-50696a9b07e2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Getting quotas for user 1bc4010eab744cf78053adb904f85dc5 and project a49eb5e19c0e44b3b9273f5126c0915f. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:16.992177 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b0d0456f-cf23-47ec-a661-50696a9b07e2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.068319 Sep 25 01:03:16.993005 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 134/263] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:03:16 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:17.100015 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1880984856", "imageRef": "249c58a7-3276-487a-92a6-a4c556474495", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1204173063", "networks": [{"uuid": "86f2589d-cf5e-4e76-93d2-4308f207217e"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:17.164750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] validate_networks() for [('86f2589d-cf5e-4e76-93d2-4308f207217e', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:03:17.611597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-6383735", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b6c84deb-58db-4940-b42b-a15c05ce3167"}], "security_groups": [{"name": "tempest-securitygroup--269272914"}], "key_name": "tempest-keypair-2077848609", "user_data": "}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:17.709507 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:03:17.710675 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:03:17.711187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:03:17.711603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:03:17.712020 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:03:17.722216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:17.722728 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:17.723160 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:17.723974 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:17.724373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:17.724837 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:17.746707 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Getting quotas for project a49eb5e19c0e44b3b9273f5126c0915f. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:17.754090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Getting quotas for user 1bc4010eab744cf78053adb904f85dc5 and project a49eb5e19c0e44b3b9273f5126c0915f. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:17.769784 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] validate_networks() for [('b6c84deb-58db-4940-b42b-a15c05ce3167', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:03:17.777458 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:03:17.782010 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='249c58a7-3276-487a-92a6-a4c556474495',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:03:17.889062 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8cc5405c-6c14-4e9a-ae13-8fecf6de5283 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.793593 Sep 25 01:03:17.901652 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 130/264] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:03:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 807 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:03:17.911457 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9e162fb1-0dc0-4439-a225-f15f0055a0f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:17.913191 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9e162fb1-0dc0-4439-a225-f15f0055a0f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:18.026145 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9e162fb1-0dc0-4439-a225-f15f0055a0f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:18.041692 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9e162fb1-0dc0-4439-a225-f15f0055a0f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1259 microversion: 2.1 time: 0.137594 Sep 25 01:03:18.042786 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 131/265] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:17 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1259 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:18.432594 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:03:18.433373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:03:18.433635 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:03:18.434286 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:03:18.435049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:03:18.450006 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:18.450569 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:18.451097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:18.451921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:18.452459 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:18.453273 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:18.481502 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:03:18.487638 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Getting quotas for user ca20e105b76149dd99e4aa64c62eb483 and project 5b11c2ffde89471cafaf35f8579e3ab2. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:03:18.502373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:03:18.506716 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:03:18.564355 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-bfc4b832-9b76-457e-b342-9d3bc45f5750 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.957471 Sep 25 01:03:18.565051 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 135/266] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:03:17 2022] POST /compute/v2.1/servers => generated 408 bytes in 959 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:03:18.587695 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-03f4e000-3ed7-4922-9496-d51daad9c646 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:18.589069 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-03f4e000-3ed7-4922-9496-d51daad9c646 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:18.723229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-03f4e000-3ed7-4922-9496-d51daad9c646 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:18.740035 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-03f4e000-3ed7-4922-9496-d51daad9c646 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1243 microversion: 2.1 time: 0.166516 Sep 25 01:03:18.745459 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 132/267] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:18 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1243 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:19.086350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:19.088885 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:19.101490 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:19.102781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:19.103710 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:19.104963 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:19.106132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:19.107198 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:19.228638 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:19.238250 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1a2a266f-9790-4b1c-91c5-e7afddb259d9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1255 microversion: 2.1 time: 0.159100 Sep 25 01:03:19.238924 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 136/268] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:19 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1255 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:19.772938 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:19.774269 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:19.785897 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:19.786872 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:19.787723 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:19.789715 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:19.791151 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:19.791952 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:19.888472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:19.899919 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-15bf71f6-1c14-484f-a83c-c8ae4afa4dca tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1239 microversion: 2.1 time: 0.135052 Sep 25 01:03:19.900800 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 133/269] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:19 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1239 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:20.263122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:20.263972 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:20.271287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.271713 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.272145 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:20.273394 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.273935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.274424 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:20.356097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:20.366899 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-fd421a87-dc66-4bc8-8039-551c22f39b55 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1311 microversion: 2.1 time: 0.108007 Sep 25 01:03:20.367798 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 137/270] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:20 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1311 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:20.946077 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:20.949247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:20.964507 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.966131 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.967395 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:20.969133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:20.970458 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:20.971615 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.170837 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:21.185750 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e2059b35-ec57-4c43-be1b-39fb8e6f77c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.252034 Sep 25 01:03:21.202485 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 134/271] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:20 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:21.411937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:21.414893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:21.453669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:21.455685 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:21.456648 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.457922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:21.459118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:21.460862 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:21.778151 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:21.789790 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c94e2b07-75e5-43a7-a4bf-7f6f182d9fa6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.388057 Sep 25 01:03:21.799827 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 138/272] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:21 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:22.230995 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:22.231559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:22.241807 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.242642 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.243279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:22.244029 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.244541 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.244992 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:22.341375 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:22.350280 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8466ef7b-bff5-4d9e-bda0-28d97d55fb15 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.125581 Sep 25 01:03:22.351601 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 135/273] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:22 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:22.536035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:22.536889 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:22.549527 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.550283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.550927 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:22.551810 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.552515 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.553153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:22.584704 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7c4d0974-a7d7-4c55-b5ff-dc661adc4df7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/ips" status: 200 len: 146 microversion: 2.1 time: 0.053497 Sep 25 01:03:22.585304 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 139/274] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:03:22 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/ips => generated 146 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:22.820318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:22.821522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:22.837377 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.837377 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.837377 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:22.837377 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:22.838078 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:22.838078 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.063398 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:23.074520 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4dd06903-89cc-4793-bf02-a2860cccb05b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.259681 Sep 25 01:03:23.075086 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 136/275] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:22 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:23.377945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:23.378956 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:23.389555 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.390150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.390661 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.391471 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:23.392127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:23.392788 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:23.478529 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:23.487360 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-308b86ac-808f-460e-9e89-1ed6fbe83b40 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.116578 Sep 25 01:03:23.488319 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 140/276] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:23 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:24.111689 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:24.112637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:24.120952 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.121426 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.121869 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.122580 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.123031 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.123463 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.328702 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:24.345444 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a13549a6-f745-4519-855a-5db94c008fd2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.237949 Sep 25 01:03:24.347165 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 137/277] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:24 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:24.531657 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:24.533038 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:24.542895 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.543413 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.543945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.544615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:24.545082 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:24.546189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:24.620828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:24.624728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:24.632811 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f967163c-835a-4969-a179-f0203b1bc10b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.107410 Sep 25 01:03:24.633329 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 141/278] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:24 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:25.374536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:25.379346 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:25.413438 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.414511 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.415496 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:25.417010 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.417952 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.425155 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:25.644769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:25.655505 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b365974-5c38-475e-bc16-7b654adbf58e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.289071 Sep 25 01:03:25.656214 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 138/279] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:25 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:25.667140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:25.667929 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:25.695540 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.697443 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.699835 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:25.702597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:25.703862 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:25.705073 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:25.837069 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:25.849454 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c1988376-7b07-4a27-985f-4e8545ec197e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.196566 Sep 25 01:03:25.850063 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 142/280] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:25 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:26.700936 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:26.702024 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:26.713909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.714969 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.715529 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.716851 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.717928 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.718711 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.878260 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:26.880692 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:26.890102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.891113 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.891989 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.893216 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:26.893797 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:26.894373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:26.972545 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:26.988495 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c3c5de4e-f06c-4dfc-8a75-19a258605a03 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.294797 Sep 25 01:03:26.989794 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 139/281] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:26 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:27.036642 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:27.047872 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5d11a926-d2bc-4a42-89d8-f22ec11395e9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.177475 Sep 25 01:03:27.048886 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 143/282] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:26 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:27.939865 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7dc46810-4009-42e5-bf59-b0a6245866e8"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:27.942813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:27.945410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:27.951637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:27.952137 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:27.952619 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:27.953348 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:27.953807 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:27.954240 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.024441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.025615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:28.039413 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.040261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.041136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.042464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.043303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.044077 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.251306 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:28.267125 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-be5f8b5b-13c4-4311-8cde-66d2d2c5ed96 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.252141 Sep 25 01:03:28.268222 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 144/283] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:28 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:28.277376 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:28.278565 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:28.290107 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.290979 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.291786 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.293123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:28.293981 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:28.294771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:28.389587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:28.400949 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-abd7ef5d-c31e-4b49-89ca-add9ba8ec4b5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.131031 Sep 25 01:03:28.401555 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 145/284] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:28 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:28.730511 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=14 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:29.295139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:29.296261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:29.301314 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:29.302077 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=10 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:29.303755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=80,nova_api:INSERT=4 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:29.310448 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.311172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.311581 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.312679 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.313089 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.313523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.516233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:29.525732 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-705f3a91-011e-410c-a760-483824b7f258 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.237535 Sep 25 01:03:29.526330 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 146/285] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:29 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:29.531783 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:29.532429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:29.539747 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.540290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.540812 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.541534 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:29.541991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:29.542422 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:29.629014 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:29.639660 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-57f86c48-02b0-479f-a745-63fe5588e757 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.112212 Sep 25 01:03:29.640445 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 147/286] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:29 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:30.555719 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:30.557104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:30.569118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.570370 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.571158 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.572623 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.573469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.574263 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.784955 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:30.797773 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f1e4fae5-634e-4837-815e-d2fa1ff9db13 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.249436 Sep 25 01:03:30.809147 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 148/287] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:30 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:30.816085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:30.816895 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:30.826845 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.827249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.827704 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.828491 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:30.828969 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:30.829663 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:30.941030 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:30.950347 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b1df4c60-4208-4ae0-9500-57b26c1b9cc1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.139671 Sep 25 01:03:30.951381 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 149/288] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:30 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:31.827224 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:31.828517 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:31.838498 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:31.839152 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:31.839864 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:31.840873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:31.841561 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:31.842093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:32.037362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:32.046423 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-31200830-2fff-4985-8d7d-20c89b804c0e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.226467 Sep 25 01:03:32.047020 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 150/289] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:31 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:32.052935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:32.053610 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:32.060952 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:32.061454 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:32.062115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:32.062910 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:32.063397 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:32.063977 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:32.140014 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:32.151857 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-25600a5a-539d-4a0b-8db2-f877c4e1f0b3 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.103361 Sep 25 01:03:32.153016 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 151/290] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:32 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:33.096103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:33.097144 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:33.109790 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.111170 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.111907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.113237 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.114068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.114867 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.327308 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:33.336926 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-bda4e6d4-78bf-40ee-b563-91d2d38ed77d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.245326 Sep 25 01:03:33.337529 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 152/291] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:33 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:33.342633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:33.343331 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:33.351182 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.351686 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.352407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.352946 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:33.353422 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:33.353855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:33.430866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:33.441220 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5cb0f0a2-1c9d-47cc-97f5-b94faf720f6e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.102569 Sep 25 01:03:33.441889 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 153/292] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:33 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:34.364407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:34.365152 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:34.376769 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.377555 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.378337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.379652 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.380487 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.381248 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.552936 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:34.562307 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e34ea0b7-4ef9-44a2-b886-426a04a8b727 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.201773 Sep 25 01:03:34.563265 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 154/293] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:34 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:34.567849 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:34.568572 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:34.575408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.575906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.576345 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.577093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:34.577556 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:34.577987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:34.654552 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:34.665238 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f9470b94-a894-40ca-ad0d-734c4a6b0e0a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1295 microversion: 2.1 time: 0.101088 Sep 25 01:03:34.666215 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 155/294] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:34 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1295 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:35.286741 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f9f99e1b-ad74-4186-a30b-0faf53f90e67", "device": "/dev/sdb"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:35.290390 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:35.297172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.297662 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.298094 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:35.298832 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:35.299288 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:35.299708 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:37.947736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=4 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:38.046582 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=79,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:39.422614 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-314be52a-1ece-474b-b06b-4fce4c9b49f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 11.487295 Sep 25 01:03:39.424804 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 140/295] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:03:27 2022] POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-volume_attachments => generated 194 bytes in 11490 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:39.449545 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:39.450864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:39.454004 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-bd902499-30f5-4aa8-9880-571db334685d tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "POST /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.166653 Sep 25 01:03:39.465230 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 156/296] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:03:35 2022] POST /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164/os-volume_attachments => generated 194 bytes in 4183 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:39.479445 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:39.480654 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:39.490924 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.495633 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.495841 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.496220 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.496716 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.497297 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.497597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.498192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.498532 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:39.498884 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.500406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:39.501045 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:39.525129 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:39.609297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:39.621788 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-57353e75-21fd-458e-bada-9595defc608e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1301 microversion: 2.1 time: 0.153065 Sep 25 01:03:39.622694 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 157/297] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:39 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1301 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:39.796893 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:39.806201 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3b7d2cc0-1455-488a-b63d-d144a85bd4e4 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.379499 Sep 25 01:03:39.806873 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 141/298] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:39 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:40.649545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-6c421716-b180-4cda-bc5d-b3b141dc268f req-81f0c0e8-2394-40cd-98dc-99cdb8c2736c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731a9677-0b93-4792-819c-b75b56c0f5b1", "tag": "25ea87eb-7543-4aed-9085-17cbcf974eb9"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:40.652181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:40.653463 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:40.662430 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.663735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.664357 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.665307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.665940 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.666972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.675390 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6c421716-b180-4cda-bc5d-b3b141dc268f req-81f0c0e8-2394-40cd-98dc-99cdb8c2736c service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.676778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6c421716-b180-4cda-bc5d-b3b141dc268f req-81f0c0e8-2394-40cd-98dc-99cdb8c2736c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.679420 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6c421716-b180-4cda-bc5d-b3b141dc268f req-81f0c0e8-2394-40cd-98dc-99cdb8c2736c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.717040 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-6c421716-b180-4cda-bc5d-b3b141dc268f req-81f0c0e8-2394-40cd-98dc-99cdb8c2736c service nova] Creating event network-changed:25ea87eb-7543-4aed-9085-17cbcf974eb9 for instance 731a9677-0b93-4792-819c-b75b56c0f5b1 on hv-cinder-maste Sep 25 01:03:40.724893 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-6c421716-b180-4cda-bc5d-b3b141dc268f req-81f0c0e8-2394-40cd-98dc-99cdb8c2736c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085389 Sep 25 01:03:40.726712 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 158/299] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:40.838505 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:40.840205 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:40.851814 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.852669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.853391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.854573 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:40.855579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:40.856284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:40.916279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:40.931647 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c16b15ef-1a7e-4865-b4ed-c613f4906862 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1301 microversion: 2.1 time: 0.282828 Sep 25 01:03:40.933197 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 142/300] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:40 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1301 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:41.100664 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:41.126558 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-03b0735b-3b76-4527-9420-b74da9e17ca2 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.295423 Sep 25 01:03:41.136553 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 159/301] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:40 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:41.966546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:41.967683 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:41.977048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:41.978184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:41.978768 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:41.979595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:41.980457 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:41.981026 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.158408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:42.159496 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:42.171677 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:42.172183 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:42.172736 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.173584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:42.174053 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:42.174495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:42.336493 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:42.354132 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6f07b55d-eb10-4c19-bcc1-2039b7d8b279 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.393797 Sep 25 01:03:42.358556 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 143/302] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:41 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 399 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:42.374611 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:42.390601 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ebee8069-acaf-4741-aecd-27bfc2df5f93 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.239367 Sep 25 01:03:42.391729 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 160/303] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:42 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:43.071960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-01adb1a2-99f2-43e1-a375-35848655ff5a req-dd5178c4-c705-403d-a20c-cd3ebea3d810 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a47796-f432-4684-b4da-a8f0fbf960ec", "tag": "8bf7effb-12ff-4f20-9f6a-7e7a86645f20"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:43.087910 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01adb1a2-99f2-43e1-a375-35848655ff5a req-dd5178c4-c705-403d-a20c-cd3ebea3d810 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.088579 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01adb1a2-99f2-43e1-a375-35848655ff5a req-dd5178c4-c705-403d-a20c-cd3ebea3d810 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.088976 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01adb1a2-99f2-43e1-a375-35848655ff5a req-dd5178c4-c705-403d-a20c-cd3ebea3d810 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.104209 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-01adb1a2-99f2-43e1-a375-35848655ff5a req-dd5178c4-c705-403d-a20c-cd3ebea3d810 service nova] Creating event network-changed:8bf7effb-12ff-4f20-9f6a-7e7a86645f20 for instance 96a47796-f432-4684-b4da-a8f0fbf960ec on hv-cinder-maste Sep 25 01:03:43.113348 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-01adb1a2-99f2-43e1-a375-35848655ff5a req-dd5178c4-c705-403d-a20c-cd3ebea3d810 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049666 Sep 25 01:03:43.115531 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 144/304] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:43.383461 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:43.384757 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:43.397046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.397952 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.398781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.400341 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.401383 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.402246 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.433836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:43.434899 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:43.446464 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.447268 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.448968 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.449910 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:43.450531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:43.451144 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:43.623836 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:43.635830 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f95c0da4-9e93-4a68-ac75-1d801a62e8b8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.261006 Sep 25 01:03:43.636855 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 161/305] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:43 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:44.117136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f30d8be5-359a-45e4-bda2-cfe270b442ba tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:44.124350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f30d8be5-359a-45e4-bda2-cfe270b442ba tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.125239 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f30d8be5-359a-45e4-bda2-cfe270b442ba tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.126078 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f30d8be5-359a-45e4-bda2-cfe270b442ba tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:44.132797 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:44.146644 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2c8b5e5a-d467-4322-90d7-113c841764cb tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.719135 Sep 25 01:03:44.148576 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 145/306] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:43 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:44.213411 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f30d8be5-359a-45e4-bda2-cfe270b442ba tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Going to try to stop instance {{(pid=120931) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:03:44.316000 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f30d8be5-359a-45e4-bda2-cfe270b442ba tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action" status: 202 len: 0 microversion: 2.1 time: 0.204000 Sep 25 01:03:44.324601 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 162/307] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:03:44 2022] POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:03:44.326414 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:44.327218 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:44.333941 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.334444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.335571 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:44.336429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.337621 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.338106 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:44.531363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:44.542351 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bb573302-4e16-4e5f-ae79-6d5d2c3f2cc5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.220524 Sep 25 01:03:44.542989 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 146/308] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:44 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:44.664147 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:44.664926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:44.671798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.672305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.672803 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:44.673535 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.673997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.674430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:44.843796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:44.854504 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-59f6a650-2204-48fa-973d-eb203bb92916 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.195948 Sep 25 01:03:44.855274 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 163/309] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:44 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:44.972230 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f9f99e1b-ad74-4186-a30b-0faf53f90e67", "create_info": {"type": "qcow2", "new_file": "volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.22248eb4-b0a7-4ead-bf3e-12236ef9787d.vhdx", "snapshot_id": "22248eb4-b0a7-4ead-bf3e-12236ef9787d"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:44.981320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c40cf22-5cbd-4586-b2d3-96f125e105b5(cell1) {{(pid=120932) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 25 01:03:44.981767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:44.982247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:44.982673 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.025864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.026565 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.027133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.057103 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ac9c3246-1279-4b2b-950d-1a0593264fcb req-7ec75e6b-33fc-4a30-8ef6-d3e2f1a93686 admin admin] 10.222.0.25 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.229817 Sep 25 01:03:45.057781 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 147/310] 10.222.0.25 () {64 vars in 1326 bytes} [Sun Sep 25 01:03:44 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:03:45.172328 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:45.172989 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:45.180368 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.180996 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.181499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.182283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.182804 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.183937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.364828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:45.374263 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d727c9e1-b15e-4e0a-94e8-2d8a8e35007c tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.206134 Sep 25 01:03:45.374959 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 164/311] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:45 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:45.568598 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:45.569250 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:45.575915 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.576428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.576877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.577627 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.578085 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.578504 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.768526 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:45.778622 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3b99532c-12ac-4f9e-ada7-9d9f7ee6a23a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.215375 Sep 25 01:03:45.779326 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 148/312] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:45 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:45.885301 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:45.886089 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:45.893162 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.893702 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.894141 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:45.894991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:45.895507 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:45.895931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.072911 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:46.082827 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-dec6f02f-798d-4f49-9933-e74cd80c02bd tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.202501 Sep 25 01:03:46.083533 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 165/313] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:45 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:46.403727 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:46.404961 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:46.417324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:46.418218 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:46.419037 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.420400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:46.421364 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:46.423795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.639467 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:46.653955 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-32ea85fa-5bd0-4501-be7b-e794effc2218 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.258075 Sep 25 01:03:46.654876 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 149/314] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:46 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:46.806027 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:46.806883 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:46.813840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:46.814346 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:46.814792 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.815524 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:46.816006 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:46.816433 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:46.965442 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:46.974451 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9f250dcb-dd2c-488e-aace-603b20cf3bcd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.173807 Sep 25 01:03:46.975190 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 166/315] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:46 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:47.110042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:47.110666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:47.117403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.117902 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.118379 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.119110 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.119569 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.119999 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.311981 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:47.331130 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-be0ef910-6e97-4368-93d9-2024cb21c59b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.225122 Sep 25 01:03:47.332707 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 150/316] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:47 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:47.679915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:47.680750 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:47.688304 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.688934 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.689474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.690376 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:47.690891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:47.691459 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:47.851061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:47.860614 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ee7c73a6-cae3-4532-8050-4de5288ace53 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.185507 Sep 25 01:03:47.861350 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 167/317] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:47 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:47.999012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:47.999663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:48.007084 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.007595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.008037 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.008831 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.009294 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.009731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.184542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:48.194433 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5686abd2-f366-4569-b85e-cbcb702a6521 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.199205 Sep 25 01:03:48.195036 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 151/318] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:47 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:48.368370 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:48.369207 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:48.376241 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.376782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.377233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.377972 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.378439 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.378875 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.580967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:48.590628 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-464fe3f7-ed8b-4fec-8579-9b4a88536fbb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.227335 Sep 25 01:03:48.591222 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 168/319] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:48 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:48.886385 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:48.886956 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:48.894300 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.894829 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.895303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:48.896098 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:48.896624 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:48.897086 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.076781 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:49.087149 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a43d3e45-f915-484d-9caa-08e242225559 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.205710 Sep 25 01:03:49.087825 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 152/320] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:48 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:49.219956 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:49.220493 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:49.228150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.228673 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.229177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.230195 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.230433 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.231071 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.413174 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:49.430613 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f2ced688-31af-4ebf-82f0-e6fc96e18d80 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.214454 Sep 25 01:03:49.431726 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 169/321] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:49 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:49.630008 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:49.630800 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:49.639583 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.640326 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.641056 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.642121 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:49.642838 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:49.643591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:49.809665 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:49.819249 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-44743f7e-66ec-4bbd-b6bc-be2d6b138c25 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.193156 Sep 25 01:03:49.820363 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 153/322] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:49 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:50.112862 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:50.113398 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:50.119928 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.120445 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.120891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.121620 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.122074 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.122499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.278951 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:50.295098 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0693dce2-d19c-4ff6-b447-3b4ed822a9b3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.185823 Sep 25 01:03:50.296109 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 170/323] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:50 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:50.474072 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:50.474646 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:50.483296 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.483942 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.484557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.485416 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.485981 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.486502 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.690743 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:50.701009 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f4c588fd-c452-4b48-8bea-8fd9a21f9161 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.231162 Sep 25 01:03:50.701771 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 154/324] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:50 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:50.845384 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:50.846274 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:50.854952 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.855629 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.856138 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.857184 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.857736 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.858289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:50.963867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-d65a9e4a-b9f9-4239-b6f4-09ab61fd3da2 req-6ce6fd8b-4fa1-491f-a0ce-9f9b0d58907c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a47796-f432-4684-b4da-a8f0fbf960ec", "name": "network-vif-plugged", "status": "completed", "tag": "8bf7effb-12ff-4f20-9f6a-7e7a86645f20"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:50.982784 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d65a9e4a-b9f9-4239-b6f4-09ab61fd3da2 req-6ce6fd8b-4fa1-491f-a0ce-9f9b0d58907c service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:50.983619 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d65a9e4a-b9f9-4239-b6f4-09ab61fd3da2 req-6ce6fd8b-4fa1-491f-a0ce-9f9b0d58907c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:50.984414 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d65a9e4a-b9f9-4239-b6f4-09ab61fd3da2 req-6ce6fd8b-4fa1-491f-a0ce-9f9b0d58907c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.007581 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-d65a9e4a-b9f9-4239-b6f4-09ab61fd3da2 req-6ce6fd8b-4fa1-491f-a0ce-9f9b0d58907c service nova] Creating event network-vif-plugged:8bf7effb-12ff-4f20-9f6a-7e7a86645f20 for instance 96a47796-f432-4684-b4da-a8f0fbf960ec on hv-cinder-maste Sep 25 01:03:51.017068 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-d65a9e4a-b9f9-4239-b6f4-09ab61fd3da2 req-6ce6fd8b-4fa1-491f-a0ce-9f9b0d58907c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060572 Sep 25 01:03:51.018148 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 155/325] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:51.057799 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:51.066403 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a45b9a70-74f1-4f71-9bfd-1d2d62219899 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.226939 Sep 25 01:03:51.067020 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 171/326] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:50 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:51.336361 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:51.337190 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:51.344590 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.345098 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.345543 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.346279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.346739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.347166 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.509037 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:51.520427 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7d7d2f1c-885c-4d2e-a630-bb4cede38f7e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.189801 Sep 25 01:03:51.532415 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 156/327] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:51 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:51.726264 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:51.726892 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:51.733818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.734315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.734755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.735470 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:51.735924 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:51.736351 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:51.895523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:51.904460 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5b693186-5118-40f4-9bb3-1f2ceb0a415c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.182112 Sep 25 01:03:51.905063 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 172/328] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:51 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:52.091437 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:52.092152 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:52.099249 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.099754 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.100207 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.101531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.102004 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.102447 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.354007 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:52.363051 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d21a4cf0-1a72-4070-a5f4-bdc88a462c85 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.276743 Sep 25 01:03:52.363690 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 157/329] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:52 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:52.551467 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:52.552121 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:52.559696 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.560295 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.560778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.561495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.561951 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.562430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.580969 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:52.749059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:52.769061 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-73486ce7-28ea-4322-bc8b-02bc0929e4ed tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.221303 Sep 25 01:03:52.769970 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 173/330] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:52 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:52.929878 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:52.930654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:52.938539 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.939203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.939647 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.940397 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:52.940868 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:52.941504 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:52.947177 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:53.240859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:53.250623 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ee8264b6-f496-4197-a89c-b9b2f85382df tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.324682 Sep 25 01:03:53.251357 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 158/331] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:52 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:53.387986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:53.388659 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:53.396229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.396980 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.397792 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.399102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.399927 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.400713 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.601575 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:53.610648 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e02c6984-c90f-4ee7-8cc0-7a49aceaa6b1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.226747 Sep 25 01:03:53.611672 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 174/332] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:53 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:53.801517 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:53.803003 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:53.816867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.818096 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.819351 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:53.821608 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:53.822668 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:53.823710 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.031629 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:54.045781 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-97fa61a3-1cc0-4f42-9688-23f07db27802 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.250885 Sep 25 01:03:54.046405 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 159/333] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:53 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:54.231133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:54.231890 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:54.239594 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f9f99e1b-ad74-4186-a30b-0faf53f90e67", "create_info": {"type": "qcow2", "new_file": "volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.9a697a42-6523-4766-9fb3-bd0bb2abe2e9.vhdx", "snapshot_id": "9a697a42-6523-4766-9fb3-bd0bb2abe2e9"}}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:54.240212 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.241058 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.241658 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.242488 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.243124 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.243618 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.254603 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),2c40cf22-5cbd-4586-b2d3-96f125e105b5(cell1) {{(pid=120931) load_cells /opt/stack/nova/nova/compute/api.py:319}} Sep 25 01:03:54.255777 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.257651 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.258694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.280425 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-584a80e2-3af3-42d5-8406-e52d83b13650 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/ips" status: 200 len: 149 microversion: 2.20 time: 0.054687 Sep 25 01:03:54.281144 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 160/334] 10.222.0.26 () {60 vars in 1289 bytes} [Sun Sep 25 01:03:54 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/ips => generated 149 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:03:54.286806 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:54.287616 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:54.296518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.297266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.297934 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.298987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.299730 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.300410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.329672 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.330488 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.331225 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.377644 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-7b29a215-ff4a-48e0-bfc9-16e422634c34 req-f9e72066-d1a3-4b72-bb63-1d8693e4eb1d admin admin] 10.222.0.25 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.205565 Sep 25 01:03:54.379066 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 175/335] 10.222.0.25 () {64 vars in 1326 bytes} [Sun Sep 25 01:03:54 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:03:54.532865 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:54.550759 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-41b0a1e8-3c28-4f81-8cb9-52e7f904fe12 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.267550 Sep 25 01:03:54.551828 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 161/336] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:54 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:54.640908 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:54.642196 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:54.653601 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.654212 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.654729 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.655771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:54.656440 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:54.657136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:54.878022 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:54.889784 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e3e6e823-e672-4bed-a403-dc5ad58885e5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1368 microversion: 2.1 time: 0.257488 Sep 25 01:03:54.890379 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 176/337] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:54 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1368 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:55.074108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:55.074826 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:55.077327 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:55.085671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.086205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.086663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.087523 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.087992 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.088463 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.278381 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:55.293980 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-35379b8f-74db-4a42-b4b7-49b212ac5486 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.224227 Sep 25 01:03:55.295173 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 162/338] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:55 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:55.330258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-4de35824-6879-4b66-9ece-04167c644fd0 req-4eeff5b2-7355-4c09-9c9b-df8a5d68bd1d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731a9677-0b93-4792-819c-b75b56c0f5b1", "name": "network-vif-plugged", "status": "completed", "tag": "25ea87eb-7543-4aed-9085-17cbcf974eb9"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:55.348483 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4de35824-6879-4b66-9ece-04167c644fd0 req-4eeff5b2-7355-4c09-9c9b-df8a5d68bd1d service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.349496 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4de35824-6879-4b66-9ece-04167c644fd0 req-4eeff5b2-7355-4c09-9c9b-df8a5d68bd1d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.350308 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4de35824-6879-4b66-9ece-04167c644fd0 req-4eeff5b2-7355-4c09-9c9b-df8a5d68bd1d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.374740 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-4de35824-6879-4b66-9ece-04167c644fd0 req-4eeff5b2-7355-4c09-9c9b-df8a5d68bd1d service nova] Creating event network-vif-plugged:25ea87eb-7543-4aed-9085-17cbcf974eb9 for instance 731a9677-0b93-4792-819c-b75b56c0f5b1 on hv-cinder-maste Sep 25 01:03:55.384484 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-4de35824-6879-4b66-9ece-04167c644fd0 req-4eeff5b2-7355-4c09-9c9b-df8a5d68bd1d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061093 Sep 25 01:03:55.385681 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 177/339] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:55.585592 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:55.586081 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:55.592986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.593492 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.593938 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.594821 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.595400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.595846 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.776276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:55.790198 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-44d8b3b8-be6d-4694-89b7-52ecf7d96a52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.209084 Sep 25 01:03:55.791395 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 163/340] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:55 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:55.922023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:55.923350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:55.934074 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.934961 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.935756 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:55.937135 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:55.937998 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:55.938809 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.165069 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:56.175280 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-484a592b-a77e-49bf-8d51-54165aacae28 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1562 microversion: 2.1 time: 0.262488 Sep 25 01:03:56.175890 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 178/341] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:55 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1562 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:56.202314 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:56.203172 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:56.212299 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.213182 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.213799 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.214781 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.215858 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.216836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.329184 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:56.330378 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:56.343858 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.344466 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.344906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.345740 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.346466 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.347795 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.367443 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b2d8153d-376f-4834-bf09-d7316398816b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.169518 Sep 25 01:03:56.368277 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 164/342] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:03:56 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-interface => generated 284 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:03:56.475801 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:56.476827 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:56.487813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.488741 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.489548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.490951 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.491838 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.492671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.567805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lazy-loading 'flavor' on Instance uuid e3594bb0-3667-44b5-badd-3dcfe8b74c27 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:03:56.607627 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:56.623653 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-65d88ed7-588c-47c8-bcd1-e200e7d21670 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.300978 Sep 25 01:03:56.625171 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 179/343] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:56 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:56.826494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:56.827981 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:56.903135 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.904040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.905023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:56.907713 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:56.908771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:56.909879 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:57.034089 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e09e0cc7-5893-478d-9f6f-077356610eca tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/action" status: 202 len: 0 microversion: 2.20 time: 0.565508 Sep 25 01:03:57.035643 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 165/344] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Sep 25 01:03:56 2022] POST /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/action => generated 0 bytes in 569 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:03:57.049008 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:57.050787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:57.072926 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:57.073529 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:57.074023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:57.074876 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:57.075360 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:57.076030 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:57.095042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:57.115643 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-24a30ad1-b346-4d43-b7d6-6eaba0a18f41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.296128 Sep 25 01:03:57.117256 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 180/345] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:56 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:57.330434 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:57.350192 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:57.354513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:57.357660 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b7d9c6f0-c98d-48b2-af23-c7639003b53f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.315955 Sep 25 01:03:57.358720 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 166/346] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:57 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:03:57.658274 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:57.659587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:57.672406 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:57.673548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:57.674737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:57.676173 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:57.677068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:57.677866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:57.903034 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:57.911933 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c575f22a-92d0-499b-be0e-6ac461ddb60e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.264094 Sep 25 01:03:57.912576 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 181/347] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:57 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:58.089194 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-d23dcb75-3c19-4bdd-9980-0f484e958408 req-891980be-e134-47cb-99c4-9c9f19063a59 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a47796-f432-4684-b4da-a8f0fbf960ec", "tag": "8bf7effb-12ff-4f20-9f6a-7e7a86645f20"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:03:58.101048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d23dcb75-3c19-4bdd-9980-0f484e958408 req-891980be-e134-47cb-99c4-9c9f19063a59 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.101577 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d23dcb75-3c19-4bdd-9980-0f484e958408 req-891980be-e134-47cb-99c4-9c9f19063a59 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.102112 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d23dcb75-3c19-4bdd-9980-0f484e958408 req-891980be-e134-47cb-99c4-9c9f19063a59 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:58.116107 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-d23dcb75-3c19-4bdd-9980-0f484e958408 req-891980be-e134-47cb-99c4-9c9f19063a59 service nova] Creating event network-changed:8bf7effb-12ff-4f20-9f6a-7e7a86645f20 for instance 96a47796-f432-4684-b4da-a8f0fbf960ec on hv-cinder-maste Sep 25 01:03:58.122335 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-d23dcb75-3c19-4bdd-9980-0f484e958408 req-891980be-e134-47cb-99c4-9c9f19063a59 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037006 Sep 25 01:03:58.122992 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 167/348] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:03:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:03:58.173203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:58.174309 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:58.183710 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.184456 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.184829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:58.185564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.186083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.186521 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:58.390796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:58.392983 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:58.398926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:58.403638 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.404528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.405638 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:58.406388 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.407114 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.407843 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:58.409705 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-bf459dfe-4b94-4b54-8ab1-fc3725594881 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.254834 Sep 25 01:03:58.410400 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 182/349] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:58 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:03:58.667208 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:58.683315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:58.686547 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:58.688833 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-017924b0-4076-450f-9b12-159e9c1b7c0d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.305409 Sep 25 01:03:58.690152 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 168/350] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:58 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:03:58.947258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:58.948488 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:58.959622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.960585 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.961326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:58.962578 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:58.963373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:58.964130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:59.191909 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:59.207270 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e1003449-2331-47ab-bab6-3045ece2dd60 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.267721 Sep 25 01:03:59.208368 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 183/351] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:58 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:59.451886 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:59.454437 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:59.476877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:59.489263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:59.490150 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:59.491518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:59.492356 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:59.493133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:59.721302 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:03:59.722626 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:03:59.730261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=76 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:03:59.732469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:59.733158 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:59.733904 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:59.734751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:03:59.735301 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:03:59.735995 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:03:59.929406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:59.930160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:59.947378 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7adfbb07-a9a7-485b-bb65-ac11d59646d1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.499063 Sep 25 01:03:59.947378 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 169/352] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:03:59 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:03:59.947705 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:59.948715 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:03:59.951012 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0381556c-a10a-4f5f-9404-1ac9e4bfd2a0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.234216 Sep 25 01:03:59.952726 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 184/353] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:03:59 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:00.012043 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "f9f99e1b-ad74-4186-a30b-0faf53f90e67", "create_info": {"type": "qcow2", "new_file": "volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.091c12a0-307f-495e-aad8-13ff5cb3c0ee.vhdx", "snapshot_id": "091c12a0-307f-495e-aad8-13ff5cb3c0ee"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:00.016108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.016627 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.017062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.026662 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.027149 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.027587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.043632 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-819f382e-c1df-49d3-9879-9af55a3d8de8 req-36d69732-5bdb-4a6a-b61a-5fecee220d28 admin admin] 10.222.0.25 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.096974 Sep 25 01:04:00.044247 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 170/354] 10.222.0.25 () {64 vars in 1326 bytes} [Sun Sep 25 01:03:59 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:04:00.245775 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:00.246444 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:00.253245 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.253734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.254173 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.254893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.255338 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.255761 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.672239 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:00.681419 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2d9ab39d-57f2-4ada-9d2d-cae21a784117 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1359 microversion: 2.1 time: 0.440901 Sep 25 01:04:00.682023 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 185/355] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:00 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1359 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:00.970746 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:00.971592 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:00.978360 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.978844 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.979280 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.979591 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:00.979988 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.980225 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:00.980472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.981180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.986726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.987196 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.987632 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:00.988343 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:00.989083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:00.989722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.144465 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.145426 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.155677 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.156031 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c0f91232-1fc8-4cb8-8afa-799872559317 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.189786 Sep 25 01:04:01.156582 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 171/356] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:00 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:01.157171 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.158371 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9100685d-9dc8-4159-8dae-0437167a5495 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.182756 Sep 25 01:04:01.158947 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 186/357] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:00 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:01.705528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:01.706162 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:01.712973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.713462 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.713894 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.714614 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.715066 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.715483 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.872854 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:01.881327 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3427cf5e-73a5-43fd-a008-01696a219dd1 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1550 microversion: 2.1 time: 0.180419 Sep 25 01:04:01.882627 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 172/358] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:01 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1550 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:01.908261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:01.908975 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:01.917249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.917882 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.918416 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:01.919226 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:01.919776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:01.920297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.071857 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:02.080881 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-130b36ea-1fac-42af-b598-4ca130633d10 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1550 microversion: 2.1 time: 0.176269 Sep 25 01:04:02.081485 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 187/359] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:01 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1550 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:02.107414 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:02.118041 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:02.119585 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Searching by: {'deleted': False, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f'} {{(pid=120932) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 25 01:04:02.132444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.133202 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.133922 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.135300 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.136108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.136891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.183313 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:02.184258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:02.191919 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.192854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.193344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.194757 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.195827 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.197223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.311435 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.multi_cell_list [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120932) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 25 01:04:02.406766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:02.423445 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6c6e337c-a89f-488c-be2b-464ece2f00c8 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.246144 Sep 25 01:04:02.424603 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 188/360] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:02 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:02.427344 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3fba9e42-9b0a-45b7-8b03-19b07abea3a7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.327508 Sep 25 01:04:02.428170 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 173/361] 10.222.0.26 () {58 vars in 1125 bytes} [Sun Sep 25 01:04:02 2022] GET /compute/v2.1/servers => generated 343 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:02.433341 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:02.434451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:02.440270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:02.440924 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:02.445759 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.446635 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.447402 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.447886 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.448537 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.448895 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.449013 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.449522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:02.449621 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.449977 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:02.450317 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.450428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:02.480004 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:02.668377 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:02.677262 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-80d282f6-93cf-4491-83e5-e13a2c4a624d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1550 microversion: 2.1 time: 0.240871 Sep 25 01:04:02.677871 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 174/362] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:02 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1550 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:02.685508 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:02.695775 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:02.697308 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:02.698656 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a1d21a5d-849f-4994-9ad2-5ae0bdcca3f6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.272723 Sep 25 01:04:02.699361 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 189/363] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:02 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:03.449705 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:03.450577 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:03.458328 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.458827 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.459381 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.460717 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.461055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.462218 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.627039 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:03.644183 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22c1bc2a-a52e-4bcb-b4ee-e26f5fc1c2a7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.197995 Sep 25 01:04:03.645346 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 175/364] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:03 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:03.743858 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:03.744680 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:03.753858 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.754681 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.755394 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.756608 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.757600 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.758330 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.941832 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:03.949114 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:03.949379 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.950239 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.950931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.958441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:03.960201 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:03.961731 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5f70d4df-5525-4110-aebd-1b495d840939 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.223121 Sep 25 01:04:03.962869 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 190/365] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:03 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:03.965676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:03.966317 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:03.966887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:03.994218 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-e1cbb4eb-41c5-464b-a61e-bc5387bf75de req-a819708d-d35e-47b6-ac62-e3cd7b632dd2 admin admin] 10.222.0.25 "DELETE /compute/v2.1/os-assisted-volume-snapshots/22248eb4-b0a7-4ead-bf3e-12236ef9787d?delete_info=%7B%22file_to_merge%22:%20%22volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.22248eb4-b0a7-4ead-bf3e-12236ef9787d.vhdx%22,%20%22volume_id%22:%20%22f9f99e1b-ad74-4186-a30b-0faf53f90e67%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.128960 Sep 25 01:04:03.994990 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 176/366] 10.222.0.25 () {62 vars in 1800 bytes} [Sun Sep 25 01:04:03 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/22248eb4-b0a7-4ead-bf3e-12236ef9787d?delete_info=%7B%22file_to_merge%22:%20%22volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.22248eb4-b0a7-4ead-bf3e-12236ef9787d.vhdx%22,%20%22volume_id%22:%20%22f9f99e1b-ad74-4186-a30b-0faf53f90e67%22%7D => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:04:04.412737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "56bf6181-fd3c-4da0-a938-c18036c7ab41"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:04.415589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:04.417651 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:04.423484 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:04.424154 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:04.424742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:04.425580 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:04.426148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:04.426711 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:04.446469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:04.672055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:04.672761 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:04.680451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:04.680962 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:04.681410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:04.682146 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:04.682674 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:04.683105 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:04.858688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:04.868171 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2fab22fa-8730-4e6b-9529-d7ad6d75b5f0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.201206 Sep 25 01:04:04.868888 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 177/367] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:04 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:04.993806 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:04.994887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:05.006005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.006896 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.007702 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.009042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.009870 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.010611 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.207657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:05.220264 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:05.222340 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:05.223664 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3a40c2ca-b42f-45a3-9d86-a499a3cf2f4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.237637 Sep 25 01:04:05.232030 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 178/368] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:04 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:05.311146 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c465fd45-12df-40cf-ab48-38a71dd8d0a0 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.902874 Sep 25 01:04:05.312685 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 191/369] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:04:04 2022] POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments => generated 194 bytes in 905 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:05.892522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:05.893141 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:05.901115 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.901633 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.902073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:05.902783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:05.903233 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:05.903661 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:06.087516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:06.096764 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7233ea90-c4ac-4818-aa9b-885b73b8357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.208013 Sep 25 01:04:06.097566 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 179/370] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:05 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:06.260455 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:06.261192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:06.268212 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:06.268732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:06.269177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:06.269902 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:06.270477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:06.270797 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:06.462799 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:06.472465 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:06.473882 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:06.475234 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-fcad11d7-654b-4b01-8df8-469f95b8caea tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.220597 Sep 25 01:04:06.476460 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 192/371] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:06 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:07.123036 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:07.124273 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:07.131696 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.132332 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.132905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.133737 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.134309 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.134835 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.300357 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.313711 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9716fa57-013c-49b6-98dd-409e8fd6b13b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.194506 Sep 25 01:04:07.315309 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 180/372] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:07 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:07.504277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:07.505290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:07.512568 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.512983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.513422 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.514177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:07.514635 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:07.515066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:07.690307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.705102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.707858 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:07.710066 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7493ca9d-8ad5-4b50-b6f5-296c2156f368 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.209688 Sep 25 01:04:07.711085 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 193/373] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:07 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:08.364808 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:08.366057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:08.372186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=77 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:08.379805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.380367 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.380905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.381722 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.382841 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.383372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.554066 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:08.566271 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9c54f57a-977d-4269-9306-a270e838049c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1722 microversion: 2.1 time: 0.211139 Sep 25 01:04:08.567166 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 181/374] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:08 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1722 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:08.741865 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:08.743272 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:08.754336 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.755272 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.755948 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.757282 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.758393 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.758674 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.871479 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:08.872338 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:08.880049 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.880730 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.881187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.882094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:08.882744 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:08.883306 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:08.979280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:08.994802 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:08.997945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:08.999988 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-149eadf2-6d41-4260-a13d-e14b053fc989 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.265518 Sep 25 01:04:09.003875 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 194/375] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:08 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:09.064099 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:09.085602 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-04a52379-ee30-416c-adab-d73a80f3ee83 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1596 microversion: 2.1 time: 0.218925 Sep 25 01:04:09.086447 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 182/376] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:08 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1596 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:09.339043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:09.345719 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:09.346852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:09.348193 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:09.368317 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:09.369045 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:09.369409 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:09.394231 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-395fc3f8-aa39-4c88-a197-d6d085904924 req-ff3cb395-cd81-4e49-ba73-7c73222bf219 admin admin] 10.222.0.25 "DELETE /compute/v2.1/os-assisted-volume-snapshots/091c12a0-307f-495e-aad8-13ff5cb3c0ee?delete_info=%7B%22file_to_merge%22:%20%22volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.091c12a0-307f-495e-aad8-13ff5cb3c0ee.vhdx%22,%20%22volume_id%22:%20%22f9f99e1b-ad74-4186-a30b-0faf53f90e67%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.149970 Sep 25 01:04:09.395191 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 195/377] 10.222.0.25 () {62 vars in 1800 bytes} [Sun Sep 25 01:04:09 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/091c12a0-307f-495e-aad8-13ff5cb3c0ee?delete_info=%7B%22file_to_merge%22:%20%22volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.091c12a0-307f-495e-aad8-13ff5cb3c0ee.vhdx%22,%20%22volume_id%22:%20%22f9f99e1b-ad74-4186-a30b-0faf53f90e67%22%7D => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:04:09.595986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:09.597143 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:09.608729 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:09.609514 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:09.610240 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:09.611448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:09.612217 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:09.612982 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.017332 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.029968 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e1bb8ea1-2a29-4212-aa64-71f8f311dcb0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1699 microversion: 2.1 time: 0.441079 Sep 25 01:04:10.030642 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 183/378] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:09 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1699 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:10.034856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:10.036703 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:10.050571 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.051589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.052526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.054064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.055290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.056154 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.063901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d9fba1d-21fb-4235-bc78-e6fd83c26193 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:10.073214 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d9fba1d-21fb-4235-bc78-e6fd83c26193 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.074198 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d9fba1d-21fb-4235-bc78-e6fd83c26193 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.075081 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d9fba1d-21fb-4235-bc78-e6fd83c26193 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.197453 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7d9fba1d-21fb-4235-bc78-e6fd83c26193 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Going to try to start instance {{(pid=120932) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 01:04:10.284332 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7d9fba1d-21fb-4235-bc78-e6fd83c26193 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action" status: 202 len: 0 microversion: 2.1 time: 0.225216 Sep 25 01:04:10.285162 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 184/379] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:04:10 2022] POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:04:10.297002 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:10.298280 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:10.307361 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.308161 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.308641 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.309589 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:10.310075 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:10.310513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:10.346669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.366676 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.370551 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.373206 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c7dbd656-c2e7-4fe7-8f54-a89bea0229ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.347941 Sep 25 01:04:10.374486 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 196/380] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:10 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:10.603957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:10.613977 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bfdfb0c0-5d79-4098-a0b6-2a91bd0e4f6e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1708 microversion: 2.1 time: 0.322656 Sep 25 01:04:10.614671 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 185/381] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:10 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1708 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:11.402738 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:11.403355 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:11.411399 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:11.411902 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:11.412346 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:11.413603 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:11.414059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:11.414478 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:11.606796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:11.620882 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:11.622701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:11.624937 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e0d5813c-d24f-4fb8-8e93-e3bb559ee3ad tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.226527 Sep 25 01:04:11.625820 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 197/382] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:11 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:11.648708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:11.651110 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:11.663819 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:11.664599 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:11.665379 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:11.666601 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:11.667397 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:11.668174 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:11.959524 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:11.978600 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-abd84e58-fa95-4c5b-b23b-7ad08dc64001 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1708 microversion: 2.1 time: 0.340562 Sep 25 01:04:11.979346 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 186/383] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:11 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1708 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:12.292268 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-83eff799-90a2-4225-8169-a0245be61b51 req-3929471f-705d-4e94-a23d-c51dcf52e8c8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731a9677-0b93-4792-819c-b75b56c0f5b1", "tag": "25ea87eb-7543-4aed-9085-17cbcf974eb9"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:12.303230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-83eff799-90a2-4225-8169-a0245be61b51 req-3929471f-705d-4e94-a23d-c51dcf52e8c8 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:12.304394 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-83eff799-90a2-4225-8169-a0245be61b51 req-3929471f-705d-4e94-a23d-c51dcf52e8c8 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:12.305093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-83eff799-90a2-4225-8169-a0245be61b51 req-3929471f-705d-4e94-a23d-c51dcf52e8c8 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:12.321512 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-83eff799-90a2-4225-8169-a0245be61b51 req-3929471f-705d-4e94-a23d-c51dcf52e8c8 service nova] Creating event network-changed:25ea87eb-7543-4aed-9085-17cbcf974eb9 for instance 731a9677-0b93-4792-819c-b75b56c0f5b1 on hv-cinder-maste Sep 25 01:04:12.328443 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-83eff799-90a2-4225-8169-a0245be61b51 req-3929471f-705d-4e94-a23d-c51dcf52e8c8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040452 Sep 25 01:04:12.329077 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 198/384] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:04:12.665205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:12.666373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:12.681654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:12.683654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:12.685132 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:12.687181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:12.688689 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:12.689560 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.016498 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:13.017367 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:13.032310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.043031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.043499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.044365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.044880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.045323 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.215516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.226576 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.229096 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.230652 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cecd5c06-a667-4229-bf39-a5df8c2a02c0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.570803 Sep 25 01:04:13.245879 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 187/385] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:12 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:13.392615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:13.414494 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ae296eb4-af59-4f8b-9337-04ec07f31a08 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1708 microversion: 2.1 time: 0.403600 Sep 25 01:04:13.415607 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 199/386] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:13 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1708 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:13.697833 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:13.703481 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.703990 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.704565 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.714472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:13.715517 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:13.716040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:13.738828 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-abd5e5c7-3ea3-4403-aa8e-6fe89c36576e req-ecdfe96e-8dfa-42d3-a35b-1f6ccdfb0649 admin admin] 10.222.0.25 "DELETE /compute/v2.1/os-assisted-volume-snapshots/9a697a42-6523-4766-9fb3-bd0bb2abe2e9?delete_info=%7B%22file_to_merge%22:%20%22volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.9a697a42-6523-4766-9fb3-bd0bb2abe2e9.vhdx%22,%20%22volume_id%22:%20%22f9f99e1b-ad74-4186-a30b-0faf53f90e67%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.117887 Sep 25 01:04:13.739428 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 188/387] 10.222.0.25 () {62 vars in 1800 bytes} [Sun Sep 25 01:04:13 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/9a697a42-6523-4766-9fb3-bd0bb2abe2e9?delete_info=%7B%22file_to_merge%22:%20%22volume-f9f99e1b-ad74-4186-a30b-0faf53f90e67.9a697a42-6523-4766-9fb3-bd0bb2abe2e9.vhdx%22,%20%22volume_id%22:%20%22f9f99e1b-ad74-4186-a30b-0faf53f90e67%22%7D => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:04:14.265010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:14.267153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:14.284303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.285219 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.286738 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.288255 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.290938 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.291720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.300060 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-225754052"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:14.305666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:14.317769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.318635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.319461 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.320736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.321537 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.322268 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.490009 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:14.501995 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:14.503568 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:14.504856 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-eb8772f2-76c5-4672-90c0-12fe94a18d0f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.246719 Sep 25 01:04:14.505457 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 200/388] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:14 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:14.511279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:14.511939 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:14.519984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.520658 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.521064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.522057 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:14.522716 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:14.523546 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:14.566241 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.network.security_group_api [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Adding security group 49ef2f1a-9078-4029-80d5-220fef05b5de to port 25ea87eb-7543-4aed-9085-17cbcf974eb9 Sep 25 01:04:14.715662 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:14.732097 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1c510e6a-4fa7-4a33-8d58-e3fbbc817ae0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1708 microversion: 2.1 time: 0.225057 Sep 25 01:04:14.733211 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 201/389] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:14 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1708 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:15.014537 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b38ac94-9271-4a49-81e9-a4379a5f8316 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.722396 Sep 25 01:04:15.016196 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 189/390] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:04:14 2022] POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/action => generated 0 bytes in 725 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:04:15.026318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:15.027669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:15.032759 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-bb0a0226-94fa-413c-9464-9de4b3cab606 req-c15e5a94-c276-4230-b2e8-9332c7601d15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731a9677-0b93-4792-819c-b75b56c0f5b1", "tag": "25ea87eb-7543-4aed-9085-17cbcf974eb9"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:15.035758 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.036630 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.037301 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.038332 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.039012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.039672 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.046527 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-bb0a0226-94fa-413c-9464-9de4b3cab606 req-c15e5a94-c276-4230-b2e8-9332c7601d15 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.047564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-bb0a0226-94fa-413c-9464-9de4b3cab606 req-c15e5a94-c276-4230-b2e8-9332c7601d15 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.048160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-bb0a0226-94fa-413c-9464-9de4b3cab606 req-c15e5a94-c276-4230-b2e8-9332c7601d15 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.064671 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-bb0a0226-94fa-413c-9464-9de4b3cab606 req-c15e5a94-c276-4230-b2e8-9332c7601d15 service nova] Creating event network-changed:25ea87eb-7543-4aed-9085-17cbcf974eb9 for instance 731a9677-0b93-4792-819c-b75b56c0f5b1 on hv-cinder-maste Sep 25 01:04:15.078406 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-bb0a0226-94fa-413c-9464-9de4b3cab606 req-c15e5a94-c276-4230-b2e8-9332c7601d15 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055336 Sep 25 01:04:15.085995 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 202/391] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:15.255234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:15.272099 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0cc8f673-ae72-4114-9977-56d40eb6d9be tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1642 microversion: 2.1 time: 0.250838 Sep 25 01:04:15.273808 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 190/392] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:15 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1642 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:15.537070 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:15.538926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:15.546678 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.547624 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.548328 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.549261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.549809 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.550313 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.760746 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:15.762975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:15.767178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:15.774652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.775350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.776307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.777348 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:15.778512 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:15.779405 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:15.783131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:15.787124 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:15.789921 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8c99e53c-533d-4886-9d74-ea2393e21ebf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.260249 Sep 25 01:04:15.790950 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 203/393] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:15 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:16.206179 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:16.210021 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:16.216920 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7990e1c8-f639-49cd-b60c-bfeb5f48eaab tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1708 microversion: 2.1 time: 0.461438 Sep 25 01:04:16.217538 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 191/394] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:15 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1708 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:16.825176 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:16.826606 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:16.834286 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:16.834784 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:16.836153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:16.837687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:16.838179 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:16.838624 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:17.001973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:17.012008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:17.013536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:17.014770 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-613f487c-3323-4f7c-9d17-4dd7a0bff090 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.193871 Sep 25 01:04:17.015744 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 204/395] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:16 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:17.241054 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:17.242315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:17.250844 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:17.251452 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:17.251898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:17.252694 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:17.253166 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:17.253590 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:17.434060 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:17.444665 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-350bdca6-c7e0-4436-b741-4b81ca715dd7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1712 microversion: 2.1 time: 0.207367 Sep 25 01:04:17.445423 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 192/396] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:17 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1712 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:18.055364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:18.056728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:18.069341 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:18.070214 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:18.070998 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:18.072293 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:18.073190 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:18.073985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:18.299043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:18.308609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:18.310108 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:18.311349 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8acfe0ac-c748-426d-ae08-391eceed11a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.264009 Sep 25 01:04:18.311963 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 205/397] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:18 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:19.351165 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:19.352101 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:19.360018 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:19.360638 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:19.361353 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:19.362606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:19.363187 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:19.363668 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:19.529584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-d535cbac-38a8-4de5-a11c-77426ede456e req-e2c9fcd6-abd2-4545-8d75-83d6b7635e8a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3594bb0-3667-44b5-badd-3dcfe8b74c27", "name": "network-vif-plugged", "status": "completed", "tag": "8914da89-09c9-40c1-90d8-87e916c3a872"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:19.543747 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:19.557375 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d535cbac-38a8-4de5-a11c-77426ede456e req-e2c9fcd6-abd2-4545-8d75-83d6b7635e8a service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:19.557876 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d535cbac-38a8-4de5-a11c-77426ede456e req-e2c9fcd6-abd2-4545-8d75-83d6b7635e8a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:19.558541 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d535cbac-38a8-4de5-a11c-77426ede456e req-e2c9fcd6-abd2-4545-8d75-83d6b7635e8a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:19.559641 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:19.576228 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-d535cbac-38a8-4de5-a11c-77426ede456e req-e2c9fcd6-abd2-4545-8d75-83d6b7635e8a service nova] Creating event network-vif-plugged:8914da89-09c9-40c1-90d8-87e916c3a872 for instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 on hv-cinder-maste Sep 25 01:04:19.577748 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:19.580410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:19.583441 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-d535cbac-38a8-4de5-a11c-77426ede456e req-e2c9fcd6-abd2-4545-8d75-83d6b7635e8a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.061311 Sep 25 01:04:19.583846 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-14e7d218-43ee-4ff2-aa67-78771777d89d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.247203 Sep 25 01:04:19.584042 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 206/398] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:04:19.585270 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 193/399] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:19 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:19.664704 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:19.665466 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:19.678216 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:19.679297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:19.680220 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:19.682568 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:19.683198 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:19.683804 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:19.844441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lazy-loading 'services' on Instance uuid 070f3413-b82a-4579-a63e-c27393bca164 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:04:19.997011 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-bd58f279-46fc-4ee8-beba-fc74d13be522 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "DELETE /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164/os-volume_attachments/f9f99e1b-ad74-4186-a30b-0faf53f90e67" status: 202 len: 0 microversion: 2.1 time: 0.341475 Sep 25 01:04:19.997805 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 207/400] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:04:19 2022] DELETE /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164/os-volume_attachments/f9f99e1b-ad74-4186-a30b-0faf53f90e67 => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:04:20.612009 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:20.612994 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:20.620950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.621477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.622020 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.622981 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:20.623557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:20.624102 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:20.781588 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:20.790922 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:20.792574 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:20.793980 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4c445a38-e863-412b-ab70-80e4b0849c8b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.186620 Sep 25 01:04:20.794640 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 194/401] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:20 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:21.823158 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:21.824041 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:21.833078 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:21.833650 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:21.834350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:21.835266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:21.835839 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:21.836316 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:21.995986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:21.998925 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:22.007976 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:22.009805 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:22.011915 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-604bab12-39ea-4e33-849d-1cc35c48dd41 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.194415 Sep 25 01:04:22.012904 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 208/402] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:21 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:22.262708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:22.263583 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:22.270572 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:22.271079 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:22.271525 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:22.272256 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:22.272777 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:22.273345 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:22.303446 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:04:22.434522 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-482f8191-e69e-4182-9ba8-58aa4c84422a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "DELETE /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 204 len: 0 microversion: 2.1 time: 0.175327 Sep 25 01:04:22.435393 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 195/403] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:04:22 2022] DELETE /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:04:22.447213 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:22.447915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:22.455855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:22.456504 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:22.457139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:22.457942 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:22.458489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:22.458948 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:22.615281 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:22.624885 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c053a205-302d-4667-9db6-561926eecb3f tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1513 microversion: 2.1 time: 0.184045 Sep 25 01:04:22.625532 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 209/404] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:22 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:23.046084 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:23.047372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:23.059317 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.060173 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.060981 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.062326 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.063200 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.063958 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.266350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:23.275955 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:23.277548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:23.278731 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6d83be69-f6e4-41b6-bf22-0ca8b7b19a76 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.237579 Sep 25 01:04:23.279308 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 196/405] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:23 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:23.665114 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:23.665967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:23.672928 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.673415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.673853 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.674695 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:23.675321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:23.675807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:23.828768 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:23.837646 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-24afcb46-3f59-44af-b672-2f53d43bcc09 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1513 microversion: 2.1 time: 0.177890 Sep 25 01:04:23.838264 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 210/406] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:23 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1513 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:24.308289 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.308960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:24.311258 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:24.318138 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.318638 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.319109 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.319964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.320472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.320908 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.496432 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:24.510513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:24.513434 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:24.515614 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7fbc8c95-2f25-4360-9036-ed908d6928da tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.211936 Sep 25 01:04:24.516658 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 197/407] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:24.861321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:24.861962 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:24.869899 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.870501 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.870954 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:24.871696 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:24.872161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:24.872633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:25.030112 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:25.040922 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8eab1227-95ec-4985-b5c3-2876c0b64662 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1513 microversion: 2.1 time: 0.183956 Sep 25 01:04:25.041537 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 211/408] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:24 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:25.557230 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:25.558254 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:25.566295 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:25.566806 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:25.567283 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:25.568047 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:25.568559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:25.569080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:25.724338 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:25.734320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:25.735816 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:25.737082 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-df8a413a-1cd4-4c18-9525-2cb74b399468 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.184626 Sep 25 01:04:25.737773 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 198/409] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:25 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:26.070807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:26.072121 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:26.091683 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.092594 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.093774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.095241 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.096035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.096911 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.278813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:26.288052 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-49083258-32da-45ae-9428-ca5dc949ca92 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1513 microversion: 2.1 time: 0.225620 Sep 25 01:04:26.288897 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 212/410] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:26 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1513 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:26.764690 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:26.765884 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:26.772737 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.773239 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.773679 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.774415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:26.774871 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:26.775443 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:26.941587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:26.950658 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:26.952143 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:26.953407 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-97d62d25-4077-4ed6-9f1b-7a51f1b18b34 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.192927 Sep 25 01:04:26.953987 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 199/411] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:26 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:27.327712 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:27.328425 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:27.335689 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.336328 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.337029 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:27.338895 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.339800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.340507 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:27.500663 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:27.509715 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-053bb3dc-11fc-460b-b9f0-67c399fb7bdc tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1513 microversion: 2.1 time: 0.185820 Sep 25 01:04:27.510452 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 213/412] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:27 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1513 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:27.980954 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:27.982108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:27.994803 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.995143 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.995980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:27.997372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:27.998232 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:27.998973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:28.189605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.199912 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.201556 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.202829 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-416aba15-ef00-4385-86b6-bdb471676c57 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.226604 Sep 25 01:04:28.203428 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 200/413] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:27 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:28.536023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:28.537025 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:28.544232 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:28.544818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:28.545270 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:28.546052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:28.546508 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:28.546977 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:28.740280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:28.751269 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-457f2892-7136-44d3-8a11-bd8bdc2f902a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1513 microversion: 2.1 time: 0.219325 Sep 25 01:04:28.752110 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 214/414] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:28 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1513 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:29.235246 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:29.237640 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:29.252714 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.253114 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.253639 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.254904 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.255898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.256535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.268699 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-ffaab621-4599-4896-964b-5be2fb6c5e27 req-d01f540b-8543-4a19-8ac6-51bc76b4cad7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "070f3413-b82a-4579-a63e-c27393bca164", "name": "network-vif-deleted", "tag": "55055f5c-0786-4020-95fd-cc8119259b63"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:29.282973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-ffaab621-4599-4896-964b-5be2fb6c5e27 req-d01f540b-8543-4a19-8ac6-51bc76b4cad7 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.283598 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-ffaab621-4599-4896-964b-5be2fb6c5e27 req-d01f540b-8543-4a19-8ac6-51bc76b4cad7 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.284047 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-ffaab621-4599-4896-964b-5be2fb6c5e27 req-d01f540b-8543-4a19-8ac6-51bc76b4cad7 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.298116 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-ffaab621-4599-4896-964b-5be2fb6c5e27 req-d01f540b-8543-4a19-8ac6-51bc76b4cad7 service nova] Creating event network-vif-deleted:55055f5c-0786-4020-95fd-cc8119259b63 for instance 070f3413-b82a-4579-a63e-c27393bca164 on hv-cinder-maste Sep 25 01:04:29.305688 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-ffaab621-4599-4896-964b-5be2fb6c5e27 req-d01f540b-8543-4a19-8ac6-51bc76b4cad7 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040978 Sep 25 01:04:29.307449 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 215/415] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:04:29.476872 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:29.488025 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:29.490000 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:29.491472 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-733fa7d4-88f1-4702-a9f7-345a29eeafd3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1743 microversion: 2.20 time: 0.263104 Sep 25 01:04:29.504433 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 201/416] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:29 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1743 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:29.784328 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:29.785573 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:29.789548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=62 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:29.799714 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.801018 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.802094 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.804452 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.805619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.806696 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.849722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:29.850711 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:29.851547 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:29.852457 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lazy-loading 'fault' on Instance uuid 070f3413-b82a-4579-a63e-c27393bca164 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:04:29.921748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:29.936923 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-64eec024-69df-4a2e-a80e-a3ff713a4a81 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 200 len: 1308 microversion: 2.1 time: 0.161425 Sep 25 01:04:29.937922 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 216/417] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:29 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 1308 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:30.542057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:30.543734 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:30.556828 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:30.557496 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:30.558060 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:30.558903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:30.559415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:30.560258 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:30.773851 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:30.789393 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:30.792231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:30.794426 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aecdfb09-93f8-4d91-bdd6-f2b506abcab8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.260371 Sep 25 01:04:30.795498 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 202/418] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:30 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:30.976269 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:30.977365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 070f3413-b82a-4579-a63e-c27393bca164] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:30.985643 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:30.986145 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:30.986594 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:30.987358 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:30.987824 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:30.988263 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:31.018555 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] HTTP exception thrown: Instance 070f3413-b82a-4579-a63e-c27393bca164 could not be found. Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Request method failure captured: Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 HTTP/1.1 Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6ixunnO8EIpGcX0acTRzmqjagB81ENCvkgRxvxqYRcMdviIHDgdJINOt6ga_VkU4Kgw2FLTtfK02m0JG6dKz1Tg5AYF2Vdr5ttPdRzYs91mg1DF0RpXL9-0kDpuuM514Tu7mYYYbz9DYCqwi8TDstMpcR9uniUODHUNukFGg9FWkY0 Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: f53d77003a86430b93638b729930f788 Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1122133076 Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:04:31.023206 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53d77003a86430b93638b729930f788", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53d77003a86430b93638b729930f788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53d77003a86430b93638b729930f788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53d77003a86430b93638b729930f788"}]}] Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-VolumesSnapshotTestJSON-1122133076 Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: f53d77003a86430b93638b729930f788 Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1122133076 Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-VolumesSnapshotTestJSON-1122133076-project Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 2413fa59e75741a68f391e55a8a7dc2e Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-VolumesSnapshotTestJSON-1122133076-project Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 070f3413-b82a-4579-a63e-c27393bca164 could not be found. Sep 25 01:04:31.025213 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '070f3413-b82a-4579-a63e-c27393bca164'} Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 070f3413-b82a-4579-a63e-c27393bca164 could not be found. Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:04:31.026340 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 070f3413-b82a-4579-a63e-c27393bca164 could not be found. Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 070f3413-b82a-4579-a63e-c27393bca164 could not be found. Sep 25 01:04:31.027867 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:04:31.029134 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Returning 404 to user: Instance 070f3413-b82a-4579-a63e-c27393bca164 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:04:31.029134 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-349d7b2a-2b8d-4173-a050-7a3bf4babce5 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164" status: 404 len: 111 microversion: 2.1 time: 0.053999 Sep 25 01:04:31.029134 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 217/419] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:30 2022] GET /compute/v2.1/servers/070f3413-b82a-4579-a63e-c27393bca164 => generated 111 bytes in 56 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:04:31.839661 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:31.840853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:31.855960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:31.857010 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:31.858021 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:31.859553 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:31.860977 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:31.862038 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:32.090293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:32.100964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:32.102868 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:32.104142 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-eba4989a-9071-4642-8a2b-8d3f5518f7fd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.273435 Sep 25 01:04:32.120675 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 203/420] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:31 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:33.135130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:33.136001 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:33.147083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.148126 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.149407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.151157 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:33.152653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:33.153477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:33.378374 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:33.399108 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:33.402608 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:33.405190 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7679e87d-68b4-4295-9087-47009fa44b51 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.276775 Sep 25 01:04:33.406730 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 218/421] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:33 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:34.452787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:34.453725 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:34.466649 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:34.467810 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:34.468533 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:34.470102 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:34.471162 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:34.472067 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:34.723754 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:34.744968 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:34.748398 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:34.751117 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6897bb3b-69bc-4582-b64f-ba87031e2bb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.305396 Sep 25 01:04:34.752372 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 204/422] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:34 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:35.454255 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1236693650", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "networks": [{"uuid": "84c2657c-a215-4c98-b766-afc28d2d4bc3"}]}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:35.540319 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] validate_networks() for [('84c2657c-a215-4c98-b766-afc28d2d4bc3', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:04:35.791879 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:35.793077 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:35.805088 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:35.806021 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:35.806854 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:35.808307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:35.809389 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:35.810486 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.057424 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:36.072227 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:36.075932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:36.078513 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-baf3b78a-b851-4ece-97b0-1bd83245d36f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.293777 Sep 25 01:04:36.096978 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 205/423] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:35 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:36.183654 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:04:36.184076 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:04:36.184901 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:04:36.185423 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:04:36.185791 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:04:36.197589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:36.198234 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:36.198874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.199830 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:36.200472 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:36.200927 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:36.221850 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Getting quotas for project f53d77003a86430b93638b729930f788. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:04:36.228508 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Getting quotas for user 2413fa59e75741a68f391e55a8a7dc2e and project f53d77003a86430b93638b729930f788. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:04:36.252091 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:04:36.255600 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:04:36.352422 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4a13b346-428e-46d7-ba4a-3a174e068874 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.899022 Sep 25 01:04:36.360805 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 219/424] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:04:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 917 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:04:36.370415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fbd9f1ce-e590-476c-9908-2791d54c52d0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:36.374800 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fbd9f1ce-e590-476c-9908-2791d54c52d0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:36.464493 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fbd9f1ce-e590-476c-9908-2791d54c52d0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:36.474619 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fbd9f1ce-e590-476c-9908-2791d54c52d0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1219 microversion: 2.1 time: 0.111822 Sep 25 01:04:36.475581 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 206/425] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:36 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1219 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:37.126012 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:37.128178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:37.148974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:37.149929 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:37.151265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:37.152746 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:37.153852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:37.154622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:37.495883 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:37.507403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:37.509576 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:37.524428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:37.525285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:37.526119 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:37.531181 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:37.535676 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:37.538258 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:37.539588 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:37.539836 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ee5b386b-3834-448e-abbf-942a5d449b9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.421949 Sep 25 01:04:37.540601 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:37.541345 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 220/426] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:37 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 426 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:37.620205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:37.630532 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:37.636163 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-633d178f-4e29-461c-80c7-8058531b943a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1271 microversion: 2.1 time: 0.135797 Sep 25 01:04:37.654711 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 207/427] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:37 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1271 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:38.666324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:38.667371 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:38.674452 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:38.675542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:38.679820 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:38.692301 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:38.693801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:38.695392 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:38.695856 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:38.696423 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:38.696885 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:38.697657 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:38.698055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:38.698609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:38.699184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:38.699603 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:38.700628 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:38.826985 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:38.842093 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3aa2e5bf-00c0-44de-bdfe-61137a73acc8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1277 microversion: 2.1 time: 0.182652 Sep 25 01:04:38.857226 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 208/428] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:38 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1277 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:39.032128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:39.045705 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:39.050450 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:39.053630 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2e75d19d-65b3-41ee-950d-da08008f516c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.433263 Sep 25 01:04:39.062322 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 221/429] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:38 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:39.874671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:39.876593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:39.886617 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:39.887559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:39.888132 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:39.889289 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:39.890006 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:39.890799 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:40.086598 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:40.088374 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:40.099161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:40.100332 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:40.101973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:40.103000 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:40.103674 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:40.104312 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:40.301203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:40.319617 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:40.321570 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:40.323563 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-efe7821a-3070-4986-ac02-310e9a06cef4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.241877 Sep 25 01:04:40.336617 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 222/430] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:40 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:40.544607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:40.562592 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-201324da-a4c3-4516-b598-1188e2177cdf tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.692308 Sep 25 01:04:40.565538 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 209/431] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:39 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 697 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:41.380725 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:41.383629 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:41.400035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:41.403293 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:41.405400 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.406485 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:41.408217 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:41.408850 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.530155 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-bf8f1fb2-91aa-43c2-a3dc-a05fd99a57dc req-a9fb40bc-2495-4c1d-bae0-fec15ff94fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9755ab2f-1279-4821-a613-950e1edb4e5c", "tag": "5fd98772-4ded-470f-af5c-e1c431ee445e"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:41.561917 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-bf8f1fb2-91aa-43c2-a3dc-a05fd99a57dc req-a9fb40bc-2495-4c1d-bae0-fec15ff94fc6 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:41.563263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-bf8f1fb2-91aa-43c2-a3dc-a05fd99a57dc req-a9fb40bc-2495-4c1d-bae0-fec15ff94fc6 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:41.564363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-bf8f1fb2-91aa-43c2-a3dc-a05fd99a57dc req-a9fb40bc-2495-4c1d-bae0-fec15ff94fc6 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.624514 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-bf8f1fb2-91aa-43c2-a3dc-a05fd99a57dc req-a9fb40bc-2495-4c1d-bae0-fec15ff94fc6 service nova] Creating event network-changed:5fd98772-4ded-470f-af5c-e1c431ee445e for instance 9755ab2f-1279-4821-a613-950e1edb4e5c on hv-cinder-maste Sep 25 01:04:41.650501 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-bf8f1fb2-91aa-43c2-a3dc-a05fd99a57dc req-a9fb40bc-2495-4c1d-bae0-fec15ff94fc6 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.126025 Sep 25 01:04:41.657992 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 210/432] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:41.670097 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:41.672135 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:41.685337 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:41.686595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:41.687581 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.689155 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:41.690285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:41.691501 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:41.795915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:41.813845 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:41.817614 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:41.820075 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-768296d3-78b7-4e96-a89e-39b94e0f13e7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.444895 Sep 25 01:04:41.821641 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 223/433] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:41 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 448 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:42.222780 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:42.271182 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ac7e9d43-61b8-4fd1-b1a4-a7e9dd76a0ed tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.598600 Sep 25 01:04:42.296504 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 211/434] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:41 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:42.859399 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:42.860255 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:42.869121 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.869700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.870687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:42.871412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:42.871881 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:42.872323 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:43.147564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:43.169844 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:43.172935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:43.175075 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-31ba5428-8abc-4d21-9368-75e952839f86 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.320191 Sep 25 01:04:43.176096 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 224/435] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:42 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:43.326708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:43.327640 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:43.335931 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:43.336516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:43.337061 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:43.337834 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:43.338313 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:43.338747 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:43.587811 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:43.603881 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4493465c-5927-4dd3-90c0-b84c2589f26b tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.282101 Sep 25 01:04:43.605461 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 212/436] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:43 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:44.208991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:44.209846 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:44.219958 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.220771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.221382 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.222286 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.222878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.223404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.482489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:44.500280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:44.504102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:44.506578 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-81998df6-91e2-43b2-a557-591504b3d49d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.304768 Sep 25 01:04:44.508195 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 225/437] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:44 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:44.647957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:44.649117 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:44.659485 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.660080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.660565 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.661416 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:44.661911 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:44.662719 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:44.930015 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:44.944897 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-66ec369d-a8fd-4f8f-9f70-2538edd7229a tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.302957 Sep 25 01:04:44.945896 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 213/438] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:44 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:45.552926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:45.554238 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:45.564542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.565496 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.566015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:45.566823 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.567294 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.567753 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:45.777921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:45.787997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:45.790310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:45.791821 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-303c4223-3b48-457f-81bf-de5d5dc997c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1738 microversion: 2.20 time: 0.243480 Sep 25 01:04:45.792608 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 226/439] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:45 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1738 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:45.983623 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:45.984496 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:45.993262 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.993812 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.994305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:45.995070 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:45.995540 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:45.996106 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.294469 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:46.310508 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f54bc925-8321-4a85-8cf8-e9966971bf64 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.330894 Sep 25 01:04:46.311880 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 214/440] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:45 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:46.825876 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:46.827298 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:46.830391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:46.831542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=6 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:46.841831 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.842549 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.843108 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.843981 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:46.844681 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:46.845307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:46.849737 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:47.043512 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:47.057587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:47.059709 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:47.061171 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4a935c44-1542-4ea7-9cea-258ee2f64fbb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1720 microversion: 2.20 time: 0.240398 Sep 25 01:04:47.061865 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 227/441] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:46 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1720 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:47.355214 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:47.357067 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:47.359564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:47.367656 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:47.368165 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:47.368652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:47.369384 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:47.369886 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:47.370313 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:47.589676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:47.602916 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-504f7c32-0059-499b-8fec-8a02b65fe94e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.256388 Sep 25 01:04:47.604018 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 215/442] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:47 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:48.089800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:48.090680 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:48.097566 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.098061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.098506 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.099243 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.099756 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.100139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.295828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:48.307295 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:48.309984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:48.312000 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-519879d6-c739-4514-a1f9-c66bed14fec9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1720 microversion: 2.20 time: 0.226447 Sep 25 01:04:48.312964 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 228/443] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:48 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1720 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:48.644767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:48.645804 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:48.654523 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.655233 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.655780 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.656757 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:48.657329 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:48.657856 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:48.852877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:48.861585 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-174bfdd2-4555-44af-a356-1990a0976e55 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.222502 Sep 25 01:04:48.862194 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 216/444] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:48 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:49.346164 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:49.347539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:49.359748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:49.360539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:49.361195 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:49.362631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:49.363395 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:49.363866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:49.587808 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:49.597988 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:49.599728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:49.601633 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4a1272d8-5253-4e71-8e48-86ad5d056490 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1720 microversion: 2.20 time: 0.262124 Sep 25 01:04:49.602403 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 229/445] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:49 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1720 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:49.885811 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:49.886520 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:49.893815 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:49.894316 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:49.894762 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:49.895516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:49.895984 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:49.896448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:50.068774 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:50.083432 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7370746c-f2d5-4f42-a59f-cb5816c95eb1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.202042 Sep 25 01:04:50.084589 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 217/446] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:49 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:50.373607 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-fdd865b1-250e-4620-9ecf-e8ec97621321 req-78cef02f-79c9-47d5-92c1-68a789ce44a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9755ab2f-1279-4821-a613-950e1edb4e5c", "name": "network-vif-plugged", "status": "completed", "tag": "5fd98772-4ded-470f-af5c-e1c431ee445e"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:50.391926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-fdd865b1-250e-4620-9ecf-e8ec97621321 req-78cef02f-79c9-47d5-92c1-68a789ce44a8 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:50.392897 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-fdd865b1-250e-4620-9ecf-e8ec97621321 req-78cef02f-79c9-47d5-92c1-68a789ce44a8 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:50.393724 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-fdd865b1-250e-4620-9ecf-e8ec97621321 req-78cef02f-79c9-47d5-92c1-68a789ce44a8 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:50.418035 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-fdd865b1-250e-4620-9ecf-e8ec97621321 req-78cef02f-79c9-47d5-92c1-68a789ce44a8 service nova] Creating event network-vif-plugged:5fd98772-4ded-470f-af5c-e1c431ee445e for instance 9755ab2f-1279-4821-a613-950e1edb4e5c on hv-cinder-maste Sep 25 01:04:50.427476 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-fdd865b1-250e-4620-9ecf-e8ec97621321 req-78cef02f-79c9-47d5-92c1-68a789ce44a8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064580 Sep 25 01:04:50.428825 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 230/447] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:50.645101 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:50.646480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:50.659149 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:50.660125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:50.661019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:50.662693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:50.664212 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:50.665104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:50.943935 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:50.959820 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:50.963386 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:50.965703 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5a686770-2938-41f7-892b-e391422ee800 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1663 microversion: 2.20 time: 0.326461 Sep 25 01:04:50.966719 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 218/448] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:50 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1663 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:51.014052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5c3528b1-6407-4cd5-bdc0-0267646c9240"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:51.017915 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:51.029361 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.030289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.031488 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.032839 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.033505 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.033979 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.120337 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:51.121312 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:51.133317 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.134220 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.135395 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.136849 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.137775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.138591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.391182 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:51.405069 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c12ce495-a7aa-4fb2-ad3d-bbb2283f027e tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.293252 Sep 25 01:04:51.406267 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 219/449] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:51 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:04:51.517609 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3da31791-7ed2-4fb9-9d28-f5a762fb5001 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.511507 Sep 25 01:04:51.518638 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 231/450] 10.222.0.26 () {62 vars in 1364 bytes} [Sun Sep 25 01:04:51 2022] POST /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments => generated 188 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:04:51.750472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:51.751554 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:51.762003 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.762884 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.763672 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.764609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.765091 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.765536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.824419 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120932) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:04:51.942754 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-53bad365-2da9-4bed-b056-d3f5823240a7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/action" status: 202 len: 0 microversion: 2.20 time: 0.199926 Sep 25 01:04:51.943326 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 220/451] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Sep 25 01:04:51 2022] POST /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/action => generated 0 bytes in 202 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:04:51.957597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:51.959056 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:51.970461 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.971382 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.972174 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:51.973640 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:51.974372 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:51.975157 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.191504 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:52.204122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:52.205805 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:52.207131 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6c1e891f-87f1-4515-865e-5d157247a64b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1749 microversion: 2.20 time: 0.257962 Sep 25 01:04:52.207851 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 232/452] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:51 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1749 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:52.446448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:52.447320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:52.459593 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-9b916b81-5811-416a-95f8-7dc0506d097b req-787f4bf3-4505-4c24-b9c8-0cc0df77c250 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3594bb0-3667-44b5-badd-3dcfe8b74c27", "name": "network-vif-unplugged", "status": "completed", "tag": "8914da89-09c9-40c1-90d8-87e916c3a872"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:52.459891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.460847 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.461446 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.462534 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.463519 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.464332 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.475246 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9b916b81-5811-416a-95f8-7dc0506d097b req-787f4bf3-4505-4c24-b9c8-0cc0df77c250 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:52.475931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9b916b81-5811-416a-95f8-7dc0506d097b req-787f4bf3-4505-4c24-b9c8-0cc0df77c250 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:52.476508 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9b916b81-5811-416a-95f8-7dc0506d097b req-787f4bf3-4505-4c24-b9c8-0cc0df77c250 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:52.491040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.compute.server_external_events [req-9b916b81-5811-416a-95f8-7dc0506d097b req-787f4bf3-4505-4c24-b9c8-0cc0df77c250 service nova] Unable to find a host for instance e3594bb0-3667-44b5-badd-3dcfe8b74c27. Dropping event network-vif-unplugged {{(pid=120931) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 25 01:04:52.492542 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-9b916b81-5811-416a-95f8-7dc0506d097b req-787f4bf3-4505-4c24-b9c8-0cc0df77c250 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.039474 Sep 25 01:04:52.493457 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 233/453] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:04:52 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 41 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 25 01:04:52.697261 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:52.707531 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-eb37f10d-ef20-4c0f-8650-7e7b83c51bf1 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1319 microversion: 2.1 time: 0.265641 Sep 25 01:04:52.709586 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 221/454] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:52 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1319 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:53.236790 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:53.237478 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:53.245986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:53.246520 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:53.246966 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:53.247938 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:53.248556 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:53.249310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:53.467299 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:53.479985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:53.481557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:53.482792 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-02cc4853-3e98-4457-b17d-134279411354 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1749 microversion: 2.20 time: 0.251638 Sep 25 01:04:53.483381 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 234/455] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:53 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1749 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:53.739200 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:53.740403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:53.753195 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:53.754181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:53.755051 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:53.756368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:53.757281 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:53.758189 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:53.990813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:54.012105 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7bf5bada-a074-4007-86c7-ac7df4a125fe tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1507 microversion: 2.1 time: 0.280919 Sep 25 01:04:54.013000 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 222/456] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:04:53 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1507 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:04:54.028528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:54.028528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:54.028528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.029273 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.030064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.030969 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.030969 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.041619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.048285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c805d36a-64a1-4546-af4d-1966b062b009", "device": "/dev/sdb"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:54.054066 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:54.068950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.069889 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.070694 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.072354 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.073560 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.074589 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.084738 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-912de913-236f-419b-b996-cd5cbf08a95c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/ips" status: 200 len: 150 microversion: 2.1 time: 0.077610 Sep 25 01:04:54.086807 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 235/457] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:04:54 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/ips => generated 150 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:54.384189 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:04:54.531746 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:54.532899 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:54.547922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.548809 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.549621 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.551423 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:54.552277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:54.553068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:54.658246 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b5c31365-664a-47dc-bf4b-39585ed6cd57 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "POST /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.616588 Sep 25 01:04:54.660459 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 223/458] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:04:54 2022] POST /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c/os-volume_attachments => generated 194 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:54.891651 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:54.909701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:54.913221 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:54.915678 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d1be2c0b-a99f-44de-944b-7913012e3f56 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.401052 Sep 25 01:04:54.916700 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 236/459] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:54 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:55.905596 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d3d31e3-87b2-4508-8364-3908521ab87d"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:55.909638 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:55.921876 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.922967 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.923867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.924975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.925457 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.925891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.966648 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:55.967796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:55.980319 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.981299 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.982139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:55.983510 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:55.984359 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:55.985190 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:56.244543 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:56.258852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:56.261515 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:56.263569 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6732859f-2ab3-4eaa-9f57-0c4f23add089 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.304810 Sep 25 01:04:56.264474 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 237/460] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:55 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:04:56.880005 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5c567d43-81a3-43e4-98f2-541806b99a29 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.981076 Sep 25 01:04:56.882134 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 224/461] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:04:55 2022] POST /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments => generated 194 bytes in 985 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:04:57.323030 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:57.325120 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:57.340844 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.341601 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.342654 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.345061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.346031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.346838 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.653869 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:57.671763 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:57.675042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:57.677457 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-76fdf90c-5164-4e46-814b-40b02c0c8a10 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.371735 Sep 25 01:04:57.678401 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 238/462] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:57 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:04:57.777592 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c805d36a-64a1-4546-af4d-1966b062b009", "create_info": {"type": "qcow2", "new_file": "volume-c805d36a-64a1-4546-af4d-1966b062b009.339257b9-cc05-4bba-8938-e1c2bcd4705c.vhdx", "snapshot_id": "339257b9-cc05-4bba-8938-e1c2bcd4705c"}}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:04:57.784291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.785212 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.785973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.804871 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:57.805744 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:57.806504 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:57.834589 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-a590a44a-d879-4d9e-b12e-5297dbb1e5bf req-16ec1ee7-bc02-4cdc-a876-d347c43ad2f1 admin admin] 10.222.0.25 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.139449 Sep 25 01:04:57.836013 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 225/463] 10.222.0.25 () {64 vars in 1326 bytes} [Sun Sep 25 01:04:57 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:04:58.723311 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:04:58.724474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:04:58.737701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:58.738581 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:58.739401 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:58.740802 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:04:58.741802 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:04:58.742680 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:04:58.979237 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:58.996529 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:59.000562 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:04:59.002725 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a700800e-6309-4924-b975-03ae1d2eb1ec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.287397 Sep 25 01:04:59.003786 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 239/464] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:04:58 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:00.048293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:00.049190 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:00.066483 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:00.067369 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:00.067950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:00.073259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:00.073873 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:00.074439 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:00.323322 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:00.346485 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:00.350207 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:00.353966 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0daf75f6-dbdc-4eaf-8afc-0913bc43c8ae tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.312426 Sep 25 01:05:00.355356 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 226/465] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:00 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:01.420621 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:01.436426 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:01.442428 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:01.458085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.459290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.459876 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.461857 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:01.463057 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:01.464138 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:01.687993 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-96f24e94-145b-4fe6-8469-dca962918d0d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: .version_select at 0x7f11813cb9d0>, body: {"keypair": {"name": "tempest-keypair-400587366", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIQTgnOChAe+Y1R0WvnkkkGbltyzpWfC5Z9Um1rw6K84fHJdLx7pPmGQX4B2xOXuTxnk90vKjicp40zKJCBRGwE2Frx/eCMcLN4lqOf2Va/yTISR3VV6RwA8lpmYELtbQw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:01.725041 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-96f24e94-145b-4fe6-8469-dca962918d0d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:01.735976 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-96f24e94-145b-4fe6-8469-dca962918d0d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:01.801103 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-96f24e94-145b-4fe6-8469-dca962918d0d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.125214 Sep 25 01:05:01.802903 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 227/466] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:05:01 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:01.839752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:01.880616 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:01.891254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:01.894350 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b07801a0-88a4-4551-93a8-4c405ffda737 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.497694 Sep 25 01:05:01.896677 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 240/467] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:01 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:02.944757 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:02.954686 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:02.967883 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:02.969548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:02.970727 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:02.973315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:02.974789 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:02.976709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:03.451560 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:03.467815 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:03.470384 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:03.471836 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ea1cd073-7e87-444e-9b57-7feec5a65935 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.539209 Sep 25 01:05:03.487007 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 228/468] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:02 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:03.686755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] Action: 'create', calling method: >, body: {"snapshot": {"volume_id": "c805d36a-64a1-4546-af4d-1966b062b009", "create_info": {"type": "qcow2", "new_file": "volume-c805d36a-64a1-4546-af4d-1966b062b009.a4089d24-f600-45f8-b63c-5605bfcd63df.vhdx", "snapshot_id": "a4089d24-f600-45f8-b63c-5605bfcd63df"}}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:03.692751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:03.694043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:03.695665 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:03.717026 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:03.718326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:03.721027 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:03.754866 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-c40abfa9-039e-4ed9-a901-d404c9e7c4a0 req-3a57c8c9-b86e-4ff1-ba33-8765040e61ef admin admin] 10.222.0.25 "POST /compute/v2.1/os-assisted-volume-snapshots" status: 200 len: 78 microversion: 2.1 time: 0.171525 Sep 25 01:05:03.756551 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 241/469] 10.222.0.25 () {64 vars in 1326 bytes} [Sun Sep 25 01:05:03 2022] POST /compute/v2.1/os-assisted-volume-snapshots => generated 78 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:05:04.517900 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:04.523580 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:04.543394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:04.545113 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:04.545951 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:04.547359 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:04.548266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:04.549383 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:04.850074 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-413931147", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b"}], "security_groups": [{"name": "tempest-securitygroup--1437753843"}], "key_name": "tempest-keypair-400587366", "user_data": "}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:04.873709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:04.891786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:04.895363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:04.898891 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-83cb5d90-2354-4231-9844-2353932a8a63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.388593 Sep 25 01:05:04.899785 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 229/470] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:04 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:05.076732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] validate_networks() for [('3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:05:05.737847 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:05:05.738279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:05:05.738783 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:05:05.739189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:05:05.739608 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:05:05.750630 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.751132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.751132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:05.751132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.753451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.754113 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:05.784701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:05:05.799579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:05:05.816642 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:05:05.819165 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:05:05.907094 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0d244879-8090-4056-8034-d77fb19cae07 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.066936 Sep 25 01:05:05.908624 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 242/471] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:05:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1070 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 25 01:05:05.925485 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-645aad96-cdde-40bc-a240-6f7dc8a15a37 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:05.926564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-645aad96-cdde-40bc-a240-6f7dc8a15a37 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:05.962219 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:05.963890 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:05.986670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:05.987744 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:05.988859 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:05.990064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:06.001734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:06.002536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:06.096506 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-645aad96-cdde-40bc-a240-6f7dc8a15a37 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.134872 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-645aad96-cdde-40bc-a240-6f7dc8a15a37 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1240 microversion: 2.1 time: 0.198085 Sep 25 01:05:06.134872 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 230/472] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:05 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1240 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:06.335373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.357761 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.360601 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:06.362848 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3119fd94-4694-469f-9d72-88c7659ffd63 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.410734 Sep 25 01:05:06.375287 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 243/473] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:05 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:07.159407 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.160634 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:07.176355 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.177835 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.179705 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.181457 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.182640 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.183770 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.301695 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:07.312618 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-afd96d4d-afe6-47c0-b749-92cd4b06c1ae tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.160608 Sep 25 01:05:07.313379 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 231/474] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:07 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:07.400881 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:07.401957 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:07.414844 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.415501 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.416323 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.417666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:07.418480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:07.419365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:07.425208 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:07.677765 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:07.690577 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:07.692062 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:07.693335 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-906d93a5-bc12-4621-a97e-1c28c02e6e69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.301047 Sep 25 01:05:07.693924 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 244/475] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:07 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:08.339796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:08.340462 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:08.342879 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:08.352029 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.353444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.354428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.355568 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.356455 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.356964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.452750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:08.468518 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b0cac725-ab2d-449f-9d58-115ec4771071 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.132670 Sep 25 01:05:08.469385 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 232/476] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:08 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:08.751492 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:08.754140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:08.767310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.768243 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.769532 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.770893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:08.771626 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:08.772075 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:08.981036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.002032 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.006143 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.008917 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-25c08da5-14d3-4174-bfa9-01d27769faef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.270467 Sep 25 01:05:09.011033 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 245/477] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:08 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:09.503342 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:09.505044 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:09.509873 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:09.523786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:09.524747 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:09.525555 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:09.526838 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:09.528247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:09.529081 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:09.625488 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:09.634185 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e17c96ca-9e2e-4b7f-a1e6-d43496482154 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.139197 Sep 25 01:05:09.635118 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 233/478] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:09 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:10.045565 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:10.046450 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:10.054371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.055049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.055496 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:10.056223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.056728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.057160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:10.274816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:10.291672 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:10.293666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:10.295199 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1c268427-ed46-473a-b3a4-ec042adcdce6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.255401 Sep 25 01:05:10.295955 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 246/479] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:10 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:10.674676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:10.676231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:10.688970 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.689972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.690881 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:10.692338 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:10.693381 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:10.694270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:10.830673 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:10.850415 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e6c9cc54-e5ba-4b3e-998b-b07c1e1deb99 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.182755 Sep 25 01:05:10.851567 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 234/480] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:10 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:11.338004 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:11.340528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:11.356171 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.358704 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.360178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.361523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.362388 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.363263 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.642011 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.682667 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.686442 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:11.689020 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c27ac683-97eb-4035-9384-6f332ff04477 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.359385 Sep 25 01:05:11.693178 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 247/481] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:11 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:11.899675 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:11.900634 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:11.914155 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.915019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.915810 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:11.917193 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:11.917992 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:11.918741 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:12.046375 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:12.063511 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9ffa41f4-300c-4425-bbac-a015f7daa4c9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.170935 Sep 25 01:05:12.065035 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 235/482] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:11 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:12.748086 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:12.765918 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:12.794520 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:12.795309 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:12.796313 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:12.798983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:12.798983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:12.799570 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:13.025657 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:13.043470 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:13.045903 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:13.047571 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-526f771c-4956-4e84-bd71-2268b521cfb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.312322 Sep 25 01:05:13.048337 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 248/483] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:12 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:13.112816 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:13.113880 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:13.122365 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:13.123038 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:13.123603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:13.124635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:13.125311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:13.125852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:13.235015 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:13.248481 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-42863949-029d-47c4-ab96-99656ceac3ac tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.141937 Sep 25 01:05:13.249645 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 236/484] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:13 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:14.084088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:14.085163 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:14.097599 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.098528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.099346 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:14.100665 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.101471 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.102265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:14.291344 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:14.292647 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:14.314068 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.314927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.315825 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:14.317234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:14.317672 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:14.318303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:14.326956 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:14.341526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:14.344801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:14.347350 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b150db3a-8e80-43d1-ad30-cf906a5aec47 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.270910 Sep 25 01:05:14.348352 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 249/485] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:14 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:14.425436 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:14.435418 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9f1f0325-892a-4462-8edb-a4e49719f9bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.151629 Sep 25 01:05:14.436181 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 237/486] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:14 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:15.384971 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:15.385845 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:15.397913 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:15.398782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:15.399586 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:15.400922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:15.401769 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:15.402509 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:15.465058 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:15.466669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:15.481945 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:15.482876 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:15.483713 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:15.485092 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:15.485957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:15.486729 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:15.612437 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:15.628672 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-88baf90f-ef60-4708-824e-9848bdcfc33f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.171498 Sep 25 01:05:15.629748 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 238/487] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:15 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:15.670789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:15.685110 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:15.687987 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:15.690352 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-914aca44-326d-41ae-98c6-d997bce8c4cd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.312638 Sep 25 01:05:15.691415 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 250/488] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:15 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:16.677653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:16.678814 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:16.682241 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:16.693571 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:16.694955 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:16.695807 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:16.697573 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:16.698380 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:16.699195 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:16.729535 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:16.730569 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:16.736186 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=4 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:16.737546 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=6 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:16.747135 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:16.747868 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:16.748668 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:16.749984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:16.750845 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:16.751580 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:16.815674 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:16.828406 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-266c61e9-5863-44a2-8184-2413ba618270 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.158314 Sep 25 01:05:16.829408 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 239/489] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:16 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:16.980292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:16.990660 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:16.992954 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:16.994526 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-abe128e6-4ed5-4c5c-a3e0-7f83b91aeb54 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.273379 Sep 25 01:05:16.995189 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 251/490] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:16 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:05:17.865536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:17.866293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:17.876424 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:17.877341 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:17.878129 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:17.887134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:17.890094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:17.890651 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:18.010267 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:18.016327 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:18.022794 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d6083af2-7ebf-46be-80a3-3f99e3de93d5 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.162963 Sep 25 01:05:18.025021 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 240/491] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:17 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:18.033787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:18.035132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:18.048112 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:18.049492 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:18.050329 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:18.051672 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:18.052840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:18.053654 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:18.262445 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:18.274635 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:18.276179 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:18.277484 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-61582df8-a59b-482d-9b51-f9210628a72a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.252270 Sep 25 01:05:18.278122 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 252/492] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:18 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:19.065912 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:19.066652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:19.075897 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.076423 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.077004 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.077738 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.078202 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.078639 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.153650 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.162234 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e453524d-a2cd-4592-b47b-09e71dd40efe tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.100429 Sep 25 01:05:19.162821 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 241/493] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:19 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:19.308132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:19.309261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:19.318755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.319254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.320299 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.321109 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:19.321575 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:19.322006 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:19.484616 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.494530 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.495995 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:19.497310 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9d9c9119-761e-4425-aa88-2dbc43ef8fc1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.195978 Sep 25 01:05:19.497978 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 253/494] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:19 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:05:20.185444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:20.186200 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:20.194365 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:20.195540 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:20.196035 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.196880 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:20.197397 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:20.197875 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.293775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:20.302366 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-eaaa0e60-ebdf-47d2-9ec5-cfdc6d77883c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1244 microversion: 2.1 time: 0.120585 Sep 25 01:05:20.302887 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 242/495] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:20 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1244 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:20.527142 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:20.528244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:20.539827 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:20.540333 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:20.540812 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.541550 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:20.542010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:20.542442 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:20.699369 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:20.713829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:20.715518 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:20.716918 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-811fbed8-09d0-4c25-873a-ba0ab74f3d37 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.196198 Sep 25 01:05:20.717734 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 254/496] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:20 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:21.333685 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:21.334346 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:21.341788 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:21.342291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:21.342859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:21.343605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:21.344067 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:21.344535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:21.413964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:21.422781 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6944e275-0b1a-4439-93d5-fbe666d7f524 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1236 microversion: 2.1 time: 0.093328 Sep 25 01:05:21.423451 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 243/497] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:21 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1236 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:21.750282 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:21.751288 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:21.759052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:21.759612 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:21.760072 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:21.760903 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:21.761653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:21.762404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:21.988431 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:22.010376 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:22.013893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:22.016718 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-30d30691-6992-4ace-85d8-7dc5157c4901 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.271328 Sep 25 01:05:22.037722 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 255/498] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:21 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:05:22.448090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:22.448843 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:22.457052 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:22.457612 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:22.458111 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:22.458899 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:22.459442 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:22.460634 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:22.548220 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:22.558968 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bc9bdae1-eac3-46cd-b633-92572faae775 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1292 microversion: 2.1 time: 0.115473 Sep 25 01:05:22.559573 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 244/499] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:22 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1292 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:23.061907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:23.062963 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:23.074383 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.075233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.075922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.077139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.077965 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.078725 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.269589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:23.282493 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:23.284608 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:23.286423 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6450b9f5-986a-496e-8f7b-1397176f06f4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.232312 Sep 25 01:05:23.287054 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 256/500] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:23 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:23.583752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:23.584542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:23.595540 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.596563 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.597315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.598694 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:23.599584 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:23.600410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:23.695757 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:23.705224 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-832c9b96-42b3-4814-988f-1cdba81016c2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1292 microversion: 2.1 time: 0.126156 Sep 25 01:05:23.705907 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 245/501] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:23 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1292 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:24.342200 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:24.343562 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:24.357344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.358360 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.359264 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.360784 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.361530 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.362281 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.640348 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.656287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.659480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.662217 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5b25f521-d9ab-4213-9152-0ecd61cb9a55 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.327689 Sep 25 01:05:24.663360 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 257/502] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:24 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:24.704427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-3c44ac36-e2ae-4d85-9c95-ec3c406e236b req-46712b2c-90c8-4dea-8601-ee1769e51336 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3594bb0-3667-44b5-badd-3dcfe8b74c27", "name": "network-vif-plugged", "status": "completed", "tag": "8914da89-09c9-40c1-90d8-87e916c3a872"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:24.720643 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3c44ac36-e2ae-4d85-9c95-ec3c406e236b req-46712b2c-90c8-4dea-8601-ee1769e51336 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.721962 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3c44ac36-e2ae-4d85-9c95-ec3c406e236b req-46712b2c-90c8-4dea-8601-ee1769e51336 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.722739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3c44ac36-e2ae-4d85-9c95-ec3c406e236b req-46712b2c-90c8-4dea-8601-ee1769e51336 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.751383 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:24.752523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:24.762947 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-3c44ac36-e2ae-4d85-9c95-ec3c406e236b req-46712b2c-90c8-4dea-8601-ee1769e51336 service nova] Creating event network-vif-plugged:8914da89-09c9-40c1-90d8-87e916c3a872 for instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 on hv-cinder-maste Sep 25 01:05:24.773198 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-3c44ac36-e2ae-4d85-9c95-ec3c406e236b req-46712b2c-90c8-4dea-8601-ee1769e51336 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072085 Sep 25 01:05:24.774252 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 246/503] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:24.777857 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.779287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.780325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.783066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:24.784697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:24.786172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:24.923734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:24.942627 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d5a74443-df4d-4972-a9f7-93d55562746d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1298 microversion: 2.1 time: 0.214527 Sep 25 01:05:24.953564 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 258/504] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:24 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1298 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:25.698118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:25.699136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:25.722607 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:25.723486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:25.724305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:25.726231 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:25.727100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:25.727881 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:25.769573 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:25.784787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:25.791672 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:25.792603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:25.837517 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:25.840045 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:25.841859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:25.894422 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-4901fbc9-c799-4aca-b6a3-66c8856326a0 req-c1aa146e-35c0-4efd-a59e-e0569c92b15f admin admin] 10.222.0.25 "DELETE /compute/v2.1/os-assisted-volume-snapshots/a4089d24-f600-45f8-b63c-5605bfcd63df?delete_info=%7B%22file_to_merge%22:%20%22volume-c805d36a-64a1-4546-af4d-1966b062b009.a4089d24-f600-45f8-b63c-5605bfcd63df.vhdx%22,%20%22volume_id%22:%20%22c805d36a-64a1-4546-af4d-1966b062b009%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.297847 Sep 25 01:05:25.896857 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 247/505] 10.222.0.25 () {62 vars in 1800 bytes} [Sun Sep 25 01:05:25 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/a4089d24-f600-45f8-b63c-5605bfcd63df?delete_info=%7B%22file_to_merge%22:%20%22volume-c805d36a-64a1-4546-af4d-1966b062b009.a4089d24-f600-45f8-b63c-5605bfcd63df.vhdx%22,%20%22volume_id%22:%20%22c805d36a-64a1-4546-af4d-1966b062b009%22%7D => generated 0 bytes in 303 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:05:26.009973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:26.016864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:26.050678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.051626 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.055686 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.058097 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:26.058930 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:26.060158 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:26.323373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.340906 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.344081 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.345875 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-85bb6781-ee30-4a7d-8373-943ee767fa75 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.654228 Sep 25 01:05:26.346726 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 259/506] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:25 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:05:26.758309 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:26.770617 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7af82b76-665f-40d0-adf4-586f7d9bb04c tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.788688 Sep 25 01:05:26.771819 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 248/507] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:25 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 792 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:27.332012 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-07406475-5619-49f8-ade6-83180c3be094 req-f5816000-286b-494c-a034-38c876ede7be service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c", "tag": "a0c93e14-68e0-4dbc-bfab-09f855f4fda1"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:27.352590 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-07406475-5619-49f8-ade6-83180c3be094 req-f5816000-286b-494c-a034-38c876ede7be service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.353004 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-07406475-5619-49f8-ade6-83180c3be094 req-f5816000-286b-494c-a034-38c876ede7be service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.353465 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-07406475-5619-49f8-ade6-83180c3be094 req-f5816000-286b-494c-a034-38c876ede7be service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.374567 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-07406475-5619-49f8-ade6-83180c3be094 req-f5816000-286b-494c-a034-38c876ede7be service nova] Creating event network-changed:a0c93e14-68e0-4dbc-bfab-09f855f4fda1 for instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c on hv-cinder-maste Sep 25 01:05:27.379457 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-07406475-5619-49f8-ade6-83180c3be094 req-f5816000-286b-494c-a034-38c876ede7be service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054857 Sep 25 01:05:27.380345 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 260/508] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:27.395773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:27.397113 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:27.409958 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.410825 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.411653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.413025 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.414774 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.415472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.688628 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:27.700311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:27.702433 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:27.704037 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-03cbffb6-1434-4fa3-8b38-81b3d9315398 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.316105 Sep 25 01:05:27.704818 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 249/509] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:27 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:27.798391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:27.799352 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:27.807591 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.808136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.808708 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.809561 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:27.810068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:27.810539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:27.839447 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:28.001711 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:28.012131 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-be238d55-eb35-4622-acf7-8677a6d099a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.218389 Sep 25 01:05:28.012782 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 261/510] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:27 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:28.734229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:28.735356 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:28.747497 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:28.748409 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:28.749259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:28.750811 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:28.751672 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:28.752501 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:28.945500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:28.962972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:28.966160 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:28.968211 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-40793b53-1ae3-42ab-96ac-1516dd6dc138 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.240203 Sep 25 01:05:28.969141 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 250/511] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:28 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:05:29.040160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:29.041052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:29.052622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:29.053528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:29.054387 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:29.056037 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:29.057275 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:29.058065 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:29.364814 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:29.381265 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3e7c0944-d66a-43aa-b271-6bcf701bc67f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.348099 Sep 25 01:05:29.382896 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 262/512] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:29 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:30.016269 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:30.017286 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:30.030234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.031297 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.031893 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.033250 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.034138 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.034963 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.276779 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.287701 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.291017 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.292747 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-85cdf52d-1c79-4a0a-a4e3-d382fe6b68bc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1807 microversion: 2.20 time: 0.284750 Sep 25 01:05:30.293518 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 251/513] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:30 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1807 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:30.412324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:30.415458 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:30.425664 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.426851 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.427601 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.428699 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:30.429856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:30.430435 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:30.769381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:30.778585 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9dd6ab3a-1cbf-42aa-8c08-f4c4cd35fafd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.372702 Sep 25 01:05:30.779213 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 263/514] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:30 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:31.327043 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:31.328066 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:31.337816 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.338275 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.338855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.339737 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.340336 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.340901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.532715 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:31.543855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:31.545593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:31.546951 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-377917c3-e075-41c6-b843-9638093f74c2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1794 microversion: 2.20 time: 0.224241 Sep 25 01:05:31.547532 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 252/515] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:05:31 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1794 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:05:31.807882 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:31.808924 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:31.812766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=59,nova_api:INSERT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:31.821153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.821897 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.822429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:31.823266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:31.823828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:31.824355 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.042403 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:32.055252 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:32.057042 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-161b5fe5-43c9-44c9-8073-523e20ab6190 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.256720 Sep 25 01:05:32.058603 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 264/516] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:31 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:32.058940 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.059637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.060079 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.070293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:32.070975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:32.071531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:32.088615 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-0a583781-d415-4bae-b2fb-bb656143f3db req-86826276-af26-4e0d-9aa9-3e8e81d2526d admin admin] 10.222.0.25 "DELETE /compute/v2.1/os-assisted-volume-snapshots/3871f0b9-d817-471d-90f9-57dd5b8a577d?delete_info=%7B%22file_to_merge%22:%20%22volume-c805d36a-64a1-4546-af4d-1966b062b009.3871f0b9-d817-471d-90f9-57dd5b8a577d.vhdx%22,%20%22volume_id%22:%20%22c805d36a-64a1-4546-af4d-1966b062b009%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.093609 Sep 25 01:05:32.089232 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 253/517] 10.222.0.25 () {62 vars in 1800 bytes} [Sun Sep 25 01:05:31 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/3871f0b9-d817-471d-90f9-57dd5b8a577d?delete_info=%7B%22file_to_merge%22:%20%22volume-c805d36a-64a1-4546-af4d-1966b062b009.3871f0b9-d817-471d-90f9-57dd5b8a577d.vhdx%22,%20%22volume_id%22:%20%22c805d36a-64a1-4546-af4d-1966b062b009%22%7D => generated 0 bytes in 96 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:33.084705 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:33.085929 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:33.093424 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.094584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.095041 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.095776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:33.096237 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:33.096697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:33.255279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:33.264311 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-476cbc39-5d14-46df-b4dd-4674edb38039 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.184395 Sep 25 01:05:33.264957 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 265/518] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:33 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:34.073795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:34.074693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:34.082564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:34.083137 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:34.084314 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:34.084692 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:34.085155 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:34.085637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:34.252324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lazy-loading 'services' on Instance uuid 16136bd2-3934-43b5-a833-3025f5bc3079 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:34.291644 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:34.294703 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:34.300975 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:34.301537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:34.301986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:34.302792 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:34.303350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:34.304841 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:34.428023 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4fadeb87-8dcc-427c-8af3-0c640ecc1bb9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-volume_attachments/7dc46810-4009-42e5-bf59-b0a6245866e8" status: 202 len: 0 microversion: 2.1 time: 0.358989 Sep 25 01:05:34.429798 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 254/519] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:05:34 2022] DELETE /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-volume_attachments/7dc46810-4009-42e5-bf59-b0a6245866e8 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:05:34.530373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:34.542346 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5bb97889-d037-4bb3-9743-52c22834b8fd tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.256904 Sep 25 01:05:34.543131 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 266/520] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:34 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:35.569926 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:35.570817 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:35.581899 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:35.582869 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:35.583883 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:35.585439 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:35.586226 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:35.586957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:35.784241 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:35.799377 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c8f5d96d-dc14-48c9-92b5-4365f94cb431 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.235912 Sep 25 01:05:35.800470 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 255/521] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:35 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:36.700666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-eab09da2-9630-4e92-9de1-94dac1dc97fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:36.709720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eab09da2-9630-4e92-9de1-94dac1dc97fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:36.711015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eab09da2-9630-4e92-9de1-94dac1dc97fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:36.711800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eab09da2-9630-4e92-9de1-94dac1dc97fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:36.757016 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-eab09da2-9630-4e92-9de1-94dac1dc97fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Going to try to stop instance {{(pid=120931) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 25 01:05:36.829080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:36.830216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:36.831753 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-eab09da2-9630-4e92-9de1-94dac1dc97fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action" status: 202 len: 0 microversion: 2.1 time: 0.134773 Sep 25 01:05:36.833424 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 267/522] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:36 2022] POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action => generated 0 bytes in 138 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:05:36.843963 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:36.844491 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:36.845221 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:36.845973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:36.846667 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:36.847394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:36.847593 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:36.848489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:36.862942 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:36.863728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:36.864465 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:36.865870 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:36.866695 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:36.867433 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:37.089441 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:37.099579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:37.109520 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b9b3dbe6-3c3c-4d20-a1ea-41955a415d1b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.286105 Sep 25 01:05:37.111134 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 256/523] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:36 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:37.114696 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-308de4ed-10f9-4889-9408-8c6ac3f28bc1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.273154 Sep 25 01:05:37.130202 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 268/524] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:36 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:38.143445 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:38.144101 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:38.151369 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.151862 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.152305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.152806 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:38.153300 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.153474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:38.153630 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.154042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.161258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.161764 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.162236 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.162972 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.165700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.165700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.375755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:38.384823 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-06b357aa-db2f-475e-9a51-714fea43eb7f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.245217 Sep 25 01:05:38.385423 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 257/525] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:38 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:38.412183 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:38.423358 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b8fe797a-7c4f-43ee-89b8-c4359b64c82d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.274670 Sep 25 01:05:38.424352 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 269/526] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:38 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:38.549748 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:38.556566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.557448 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.558237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.574830 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:38.575668 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:38.576518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:38.606786 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-01dbb150-ebb5-43f0-b493-00a11579fa37 req-3a7151e7-fc87-449b-8a14-82ec17535149 admin admin] 10.222.0.25 "DELETE /compute/v2.1/os-assisted-volume-snapshots/339257b9-cc05-4bba-8938-e1c2bcd4705c?delete_info=%7B%22file_to_merge%22:%20%22volume-c805d36a-64a1-4546-af4d-1966b062b009.339257b9-cc05-4bba-8938-e1c2bcd4705c.vhdx%22,%20%22volume_id%22:%20%22c805d36a-64a1-4546-af4d-1966b062b009%22%7D" status: 204 len: 0 microversion: 2.1 time: 0.141850 Sep 25 01:05:38.607746 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 258/527] 10.222.0.25 () {62 vars in 1800 bytes} [Sun Sep 25 01:05:38 2022] DELETE /compute/v2.1/os-assisted-volume-snapshots/339257b9-cc05-4bba-8938-e1c2bcd4705c?delete_info=%7B%22file_to_merge%22:%20%22volume-c805d36a-64a1-4546-af4d-1966b062b009.339257b9-cc05-4bba-8938-e1c2bcd4705c.vhdx%22,%20%22volume_id%22:%20%22c805d36a-64a1-4546-af4d-1966b062b009%22%7D => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:05:38.995887 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-021cc034-cdc5-46fa-a4a4-0e374eae1bc4 req-bcff9ca4-68d9-4122-a9c6-486f7cce33a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c", "name": "network-vif-plugged", "status": "completed", "tag": "a0c93e14-68e0-4dbc-bfab-09f855f4fda1"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:39.008795 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-021cc034-cdc5-46fa-a4a4-0e374eae1bc4 req-bcff9ca4-68d9-4122-a9c6-486f7cce33a4 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:39.009295 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-021cc034-cdc5-46fa-a4a4-0e374eae1bc4 req-bcff9ca4-68d9-4122-a9c6-486f7cce33a4 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:39.009874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-021cc034-cdc5-46fa-a4a4-0e374eae1bc4 req-bcff9ca4-68d9-4122-a9c6-486f7cce33a4 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:39.025513 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-021cc034-cdc5-46fa-a4a4-0e374eae1bc4 req-bcff9ca4-68d9-4122-a9c6-486f7cce33a4 service nova] Creating event network-vif-plugged:a0c93e14-68e0-4dbc-bfab-09f855f4fda1 for instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c on hv-cinder-maste Sep 25 01:05:39.032428 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-021cc034-cdc5-46fa-a4a4-0e374eae1bc4 req-bcff9ca4-68d9-4122-a9c6-486f7cce33a4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040526 Sep 25 01:05:39.034451 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 270/528] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:39.426202 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:39.427303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:39.436314 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:39.437086 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:39.437734 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:39.438823 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:39.439360 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:39.439849 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:39.463232 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:39.464669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:39.466036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:39.476875 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:39.477606 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:39.478183 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:39.479096 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:39.479605 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:39.480212 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:39.652036 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:39.662280 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e66a7a38-abd3-431b-9a6e-7b125b23cfb3 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.242405 Sep 25 01:05:39.663189 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 259/529] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:39 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:39.675240 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:39.684957 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-688b559c-ffa2-4b10-a18f-02229c6a83c4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.229140 Sep 25 01:05:39.685552 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 271/530] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:39 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:40.693151 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:40.694204 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:40.696575 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=48 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:40.702883 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.703485 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.704059 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.704887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.705362 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.705798 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.714416 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:40.715626 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:40.728235 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.729178 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.729974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.731277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:40.732083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:40.732883 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:40.909544 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:40.926132 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7af421f4-4574-450f-a0e9-b7539d36147f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.237598 Sep 25 01:05:40.927222 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 260/531] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:40 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:40.995726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:41.007726 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5755c768-a472-4bb4-9eac-2ee46e995445 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.302184 Sep 25 01:05:41.008863 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 272/532] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:40 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:41.969846 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:41.970652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:41.978650 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:41.979154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:41.979609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:41.980357 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:41.980864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:41.981302 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:42.035344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:42.036431 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:42.049622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:42.050504 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:42.051311 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:42.052687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:42.053537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:42.055344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:42.166089 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:42.176454 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-83a688d2-fcda-4844-a7c0-f0e356d3d711 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.210939 Sep 25 01:05:42.177556 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 261/533] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:41 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:42.248227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:42.261733 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-12df4ecf-4291-458b-9c03-bb1b79b16bfb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1366 microversion: 2.1 time: 0.230635 Sep 25 01:05:42.262701 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 273/534] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:42 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:43.212289 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:43.213778 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:43.227656 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.228584 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.229419 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.230654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.231518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.232306 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.305192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:43.306685 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:43.321197 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.322097 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.322899 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.324216 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.325104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.325908 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.497045 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.516617 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ce1e4270-a427-4254-b6f4-8b5f6186f545 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.313520 Sep 25 01:05:43.518580 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 262/535] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:43 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:43.561721 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:43.562592 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:43.574182 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.575173 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.575946 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.577273 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.578123 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.578899 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.587630 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:43.602686 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ae1dbc2f-add7-4aa2-b158-ae473b73354e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1555 microversion: 2.1 time: 0.306216 Sep 25 01:05:43.603606 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 274/536] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:43 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1555 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:43.651380 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:43.652292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:43.665161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.665994 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.666774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.668279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:43.669136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:43.669859 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:43.722878 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lazy-loading 'services' on Instance uuid 9755ab2f-1279-4821-a613-950e1edb4e5c {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:43.829511 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-98c0c890-67ac-4b7a-93f8-2334c3c0d469 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.185632 Sep 25 01:05:43.844932 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 275/537] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:05:43 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c/os-interface => generated 284 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:05:43.862846 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-88ec046b-7e45-4858-8ebb-a3a31e3361b8 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c/os-volume_attachments/c805d36a-64a1-4546-af4d-1966b062b009" status: 202 len: 0 microversion: 2.1 time: 0.308827 Sep 25 01:05:43.872505 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 263/538] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:05:43 2022] DELETE /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c/os-volume_attachments/c805d36a-64a1-4546-af4d-1966b062b009 => generated 0 bytes in 316 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:05:44.158039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a3f2210d-c752-4d44-b57a-ae5c02fa40f1"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:44.161167 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:44.175147 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.175973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.176584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.177428 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.178011 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.178537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.561994 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:44.563370 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:44.577509 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.578557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.579367 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.580791 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:44.581755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:44.583042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:44.890401 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:44.913051 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8f266900-a80d-4ae1-a3d1-348066df0980 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.761253 Sep 25 01:05:44.914278 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 276/539] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:05:44 2022] POST /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 194 bytes in 764 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:44.986541 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:45.009054 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e0568177-afb7-4f9a-9d33-8dbaaedb2c1b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.455533 Sep 25 01:05:45.012505 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 264/540] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:44 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:45.632932 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-b8369034-7e91-4147-9697-2f43ee7a5e6e req-f39f6a53-2cfe-4f5b-b860-a90acacde229 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c", "tag": "a0c93e14-68e0-4dbc-bfab-09f855f4fda1"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:45.646281 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-b8369034-7e91-4147-9697-2f43ee7a5e6e req-f39f6a53-2cfe-4f5b-b860-a90acacde229 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:45.647044 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-b8369034-7e91-4147-9697-2f43ee7a5e6e req-f39f6a53-2cfe-4f5b-b860-a90acacde229 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:45.648071 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-b8369034-7e91-4147-9697-2f43ee7a5e6e req-f39f6a53-2cfe-4f5b-b860-a90acacde229 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:45.665419 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-b8369034-7e91-4147-9697-2f43ee7a5e6e req-f39f6a53-2cfe-4f5b-b860-a90acacde229 service nova] Creating event network-changed:a0c93e14-68e0-4dbc-bfab-09f855f4fda1 for instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c on hv-cinder-maste Sep 25 01:05:45.672273 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-b8369034-7e91-4147-9697-2f43ee7a5e6e req-f39f6a53-2cfe-4f5b-b860-a90acacde229 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046463 Sep 25 01:05:45.673245 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 277/541] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:46.084892 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:46.086083 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:46.099666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.100473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.102033 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.102535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.103375 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.104607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.253202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:46.254365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:46.266112 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.266903 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.267440 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.269268 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.270355 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.271134 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.289243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:46.301640 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cad6ed98-565a-4f77-8110-b38b8e8ce9fe tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.220850 Sep 25 01:05:46.305938 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 265/542] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:46 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:46.315241 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:05:46.422070 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5fb2c78e-d45c-4610-b399-00be71ace65c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "DELETE /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 204 len: 0 microversion: 2.1 time: 0.177175 Sep 25 01:05:46.423080 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 278/543] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:05:46 2022] DELETE /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 0 bytes in 180 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:05:46.434118 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:46.434926 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:46.441547 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.442041 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.442485 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.443206 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:46.443666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:46.444101 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:46.672006 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:46.681297 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c7c57ca9-7140-4ea6-92e3-b4d590f97878 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1513 microversion: 2.1 time: 0.253035 Sep 25 01:05:46.681973 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 266/544] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:46 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1513 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:47.451464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:47.452373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:47.459717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:47.460315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:47.460827 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:47.461622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:47.462205 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:47.462674 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:47.617255 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:47.629530 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-015c8439-89af-4f94-a221-cf207ea1e828 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.304017 Sep 25 01:05:47.630581 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 279/545] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:47 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:47.709266 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:47.710895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:47.721619 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:47.722481 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:47.723231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:47.724186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:47.724695 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:47.725124 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:47.918183 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:47.927307 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-59ba365a-efff-41f9-ae7d-34b215078726 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1513 microversion: 2.1 time: 0.223474 Sep 25 01:05:47.928165 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 267/546] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:47 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1513 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:48.658312 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:48.659011 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:48.667528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.668027 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.668502 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:48.669223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.669673 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.670096 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:48.824168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:48.841407 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9ebc8ce1-5f31-4e85-b9e9-0e8403da485d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.187037 Sep 25 01:05:48.842496 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 280/547] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:48 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:48.967996 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:48.969290 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:48.971990 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:48.978957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.979535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.979974 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:48.980769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:48.981221 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:48.981646 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.161995 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:49.177171 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b38d180-0e16-489f-b316-f1e0d5dc97eb tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1513 microversion: 2.1 time: 0.212871 Sep 25 01:05:49.178256 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 268/548] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:48 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1513 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:49.882661 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:49.883471 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:49.890427 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.891052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.891536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:49.892349 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:49.892898 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:49.893489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.070758 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:50.087454 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ec752e43-31ed-4b3a-9c53-81fd30a2f719 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.208278 Sep 25 01:05:50.088620 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 281/549] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:49 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:50.201742 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:50.202309 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:50.209347 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.209852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.210791 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.211518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:50.211978 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:50.212427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:50.373477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:50.382107 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-aac3a294-0e5c-477e-911c-4d2060541dee tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1513 microversion: 2.1 time: 0.184402 Sep 25 01:05:50.382826 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 269/550] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:50 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1513 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:51.125877 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.126489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:51.134267 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.134802 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.135199 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.136003 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.136650 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.137049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.314208 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.334185 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-383ef546-1876-487a-9779-7ec4fc4ea9a6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1676 microversion: 2.1 time: 0.211658 Sep 25 01:05:51.336089 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 282/551] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:51 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1676 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:51.419310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:51.420163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:51.427310 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.427807 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.428263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.429453 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:51.429928 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:51.430401 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:51.637223 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:51.646890 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ea5ee735-855e-4bb3-bb9f-085cc0102176 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1513 microversion: 2.1 time: 0.231731 Sep 25 01:05:51.648019 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 270/552] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:51 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1513 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:52.365118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:52.366150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:52.374269 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.374756 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.375197 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.375935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.376414 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.376846 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.549192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:52.559769 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b8aa26e4-0dbe-49b8-891e-6a1bff306546 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1653 microversion: 2.1 time: 0.199476 Sep 25 01:05:52.560420 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 283/553] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:52 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1653 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:52.594505 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1b9a679d-2e4d-4ed6-84e2-3ce026b44533 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:52.619785 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b9a679d-2e4d-4ed6-84e2-3ce026b44533 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.620891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b9a679d-2e4d-4ed6-84e2-3ce026b44533 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.621796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b9a679d-2e4d-4ed6-84e2-3ce026b44533 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.666606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1b9a679d-2e4d-4ed6-84e2-3ce026b44533 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Going to try to start instance {{(pid=120932) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 25 01:05:52.681160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:52.682643 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:52.699829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.701490 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.702691 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.708678 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.709729 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.711365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.769430 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1b9a679d-2e4d-4ed6-84e2-3ce026b44533 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action" status: 202 len: 0 microversion: 2.1 time: 0.180394 Sep 25 01:05:52.771040 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 271/554] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:52 2022] POST /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/action => generated 0 bytes in 185 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:05:52.791450 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:52.792747 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:52.804303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.805204 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.806401 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.807251 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:52.808415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:52.810345 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:52.974902 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:52.984923 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4346f409-0ee1-43da-8574-135ff2b6cf73 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1513 microversion: 2.1 time: 0.310464 Sep 25 01:05:52.985716 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 284/555] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:52 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1513 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:52.993487 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:52.996662 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:53.005252 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.005974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.006546 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.007811 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.008650 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.009495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.046187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'flavor' on Instance uuid 96a47796-f432-4684-b4da-a8f0fbf960ec {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:53.245836 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-79269cb1-ab01-4a9a-aa74-3a893c8d5aa9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/action" status: 200 len: 32 microversion: 2.1 time: 0.257585 Sep 25 01:05:53.247206 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 285/556] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:52 2022] POST /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/action => generated 32 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:05:53.267893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:53.269430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:53.281219 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.282080 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.282835 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.283650 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.284203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.284974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.629292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.643086 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ec306708-2307-4db2-a9a0-8f6aeb181f44 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.383815 Sep 25 01:05:53.644370 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 286/557] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:53 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:53.679017 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:53.691979 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5ad9e15b-8f4d-44b8-bd8e-0f757c6c9550 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1662 microversion: 2.1 time: 0.913620 Sep 25 01:05:53.692806 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 272/558] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:52 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1662 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:53.864419 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:53.867325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:53.874495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.875371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.875985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.877042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:53.877724 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:53.878338 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:53.997285 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-befbb4ec-2c83-43bd-a76c-5832b3e47af7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.136687 Sep 25 01:05:54.000662 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 287/559] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:05:53 2022] POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/action => generated 0 bytes in 142 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:05:54.012320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:54.017655 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:54.030176 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:54.031360 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:54.038726 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.039707 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.040864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.042271 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.043094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.043836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.059391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.060050 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.060702 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.061667 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.062308 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.062894 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.255675 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:54.267099 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-15c995be-a4fb-498d-9130-690b516eb80c tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1471 microversion: 2.1 time: 0.252295 Sep 25 01:05:54.277046 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 288/560] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:54 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1471 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:54.466476 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-27d27d61-7274-4b75-9777-9e30e488e832 req-d2cbc28e-999b-4ed2-80f1-8d01f895b76f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9755ab2f-1279-4821-a613-950e1edb4e5c", "name": "network-vif-deleted", "tag": "5fd98772-4ded-470f-af5c-e1c431ee445e"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:05:54.482902 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-27d27d61-7274-4b75-9777-9e30e488e832 req-d2cbc28e-999b-4ed2-80f1-8d01f895b76f service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.483412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-27d27d61-7274-4b75-9777-9e30e488e832 req-d2cbc28e-999b-4ed2-80f1-8d01f895b76f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.487387 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-27d27d61-7274-4b75-9777-9e30e488e832 req-d2cbc28e-999b-4ed2-80f1-8d01f895b76f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.501175 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-27d27d61-7274-4b75-9777-9e30e488e832 req-d2cbc28e-999b-4ed2-80f1-8d01f895b76f service nova] Creating event network-vif-deleted:5fd98772-4ded-470f-af5c-e1c431ee445e for instance 9755ab2f-1279-4821-a613-950e1edb4e5c on hv-cinder-maste Sep 25 01:05:54.511152 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-27d27d61-7274-4b75-9777-9e30e488e832 req-d2cbc28e-999b-4ed2-80f1-8d01f895b76f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051427 Sep 25 01:05:54.512059 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 289/561] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:05:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:05:54.663093 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:54.675332 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:54.676441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:54.676914 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a70a77e1-57c3-4e6a-9b56-cbc8d62bfc06 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1752 microversion: 2.1 time: 0.672164 Sep 25 01:05:54.677993 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 273/562] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:54 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1752 bytes in 675 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:54.692112 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.692496 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.693247 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.694052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.694774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.695337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.698625 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:INSERT=4,nova_cell1:SELECT=92,nova_cell1:UPDATE=4 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:54.735895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:54.736907 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:54.751914 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.752476 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.753185 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.754011 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:54.754577 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:54.754982 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:54.795417 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:05:54.950862 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:54.962895 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f183aeea-dbff-4900-b944-14678a191999 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.292284 Sep 25 01:05:54.964864 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 290/563] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:54 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:55.067189 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:55.079208 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f76a1e60-6a1a-4b58-8e16-7e0351149b7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1662 microversion: 2.1 time: 0.347867 Sep 25 01:05:55.079803 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 274/564] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:54 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1662 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:55.292686 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:55.293341 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:55.299781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.300278 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:55.300780 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:55.301549 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.302013 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:55.302445 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:55.342869 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.343438 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:55.343888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:55.344501 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lazy-loading 'fault' on Instance uuid 9755ab2f-1279-4821-a613-950e1edb4e5c {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:55.409292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:55.419491 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1b0090cf-87a3-4148-96b3-26e6e03c4ee2 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1309 microversion: 2.1 time: 0.131511 Sep 25 01:05:55.420366 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 291/565] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:55 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1309 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:55.728821 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:55.731999 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:55.746980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.748098 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:55.748850 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:55.750541 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.751290 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:55.752034 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:55.961875 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:55.977970 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6e7ddffa-8b4f-4376-a273-14081149a15f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1752 microversion: 2.1 time: 0.262859 Sep 25 01:05:55.979020 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 275/566] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:55 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1752 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:55.989544 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:55.990278 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:55.999334 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:55.999712 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.000165 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.000969 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.001447 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.001897 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.108988 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:56.109814 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:56.118937 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.119630 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.120295 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.121280 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.121864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.122398 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.179589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.194886 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-db12c7dc-0242-49af-b6cc-dd9d310e0247 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.209709 Sep 25 01:05:56.196013 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 292/567] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:55 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:56.307653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.320799 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-acea0b52-1c6f-407a-8b85-edd275668e7a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1666 microversion: 2.1 time: 0.219412 Sep 25 01:05:56.321401 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 276/568] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:56 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1666 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:56.457937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:56.458573 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:56.466360 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.466860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.467404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.468357 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.468860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.469294 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.508479 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:56.509023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:56.509509 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:56.510373 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lazy-loading 'fault' on Instance uuid 9755ab2f-1279-4821-a613-950e1edb4e5c {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:05:56.586788 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2413fa59e75741a68f391e55a8a7dc2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f53d77003a86430b93638b729930f788', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:56.602301 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a9c2bb66-0820-464d-99b5-e74860f7ccb0 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 200 len: 1309 microversion: 2.1 time: 0.147977 Sep 25 01:05:56.603453 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 293/569] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:56 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 1309 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:57.015984 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:57.017142 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:57.024964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.025484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.025930 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.026680 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.027145 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.027597 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.217655 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:57.228363 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-107e01cc-2344-4447-9d6b-c53314fe810a tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.216660 Sep 25 01:05:57.229127 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 277/570] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:57 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:57.239244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:57.240576 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:57.253480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.254364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.255164 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.256477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.257449 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.258218 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.438275 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:57.448593 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0d17b4cb-867f-458a-a25d-ffba83cf8007 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.216742 Sep 25 01:05:57.449201 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 294/571] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:57 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:57.629696 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:57.630204 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] [instance: 9755ab2f-1279-4821-a613-950e1edb4e5c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:57.636837 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.637340 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.637813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.638585 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:57.639053 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:57.639480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:57.656064 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] HTTP exception thrown: Instance 9755ab2f-1279-4821-a613-950e1edb4e5c could not be found. Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Request method failure captured: Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c HTTP/1.1 Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6ixunnO8EIpGcX0acTRzmqjagB81ENCvkgRxvxqYRcMdviIHDgdJINOt6ga_VkU4Kgw2FLTtfK02m0JG6dKz1Tg5AYF2Vdr5ttPdRzYs91mg1DF0RpXL9-0kDpuuM514Tu7mYYYbz9DYCqwi8TDstMpcR9uniUODHUNukFGg9FWkY0 Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: f53d77003a86430b93638b729930f788 Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1122133076 Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:05:57.658619 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_f53d77003a86430b93638b729930f788", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/f53d77003a86430b93638b729930f788"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53d77003a86430b93638b729930f788"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/f53d77003a86430b93638b729930f788"}]}] Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesSnapshotTestJSON-1122133076 Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: f53d77003a86430b93638b729930f788 Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1122133076 Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesSnapshotTestJSON-1122133076-project Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 2413fa59e75741a68f391e55a8a7dc2e Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesSnapshotTestJSON-1122133076-project Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 9755ab2f-1279-4821-a613-950e1edb4e5c could not be found. Sep 25 01:05:57.660730 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '9755ab2f-1279-4821-a613-950e1edb4e5c'} Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9755ab2f-1279-4821-a613-950e1edb4e5c could not be found. Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:05:57.661645 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9755ab2f-1279-4821-a613-950e1edb4e5c could not be found. Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9755ab2f-1279-4821-a613-950e1edb4e5c could not be found. Sep 25 01:05:57.668046 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:05:57.670097 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] Returning 404 to user: Instance 9755ab2f-1279-4821-a613-950e1edb4e5c could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:05:57.670097 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-16a2eb10-9d3b-44d3-9593-85d22188cfb7 tempest-VolumesSnapshotTestJSON-1122133076 tempest-VolumesSnapshotTestJSON-1122133076-project] 10.222.0.26 "GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c" status: 404 len: 111 microversion: 2.1 time: 0.035637 Sep 25 01:05:57.670097 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 278/572] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:57 2022] GET /compute/v2.1/servers/9755ab2f-1279-4821-a613-950e1edb4e5c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:05:58.254877 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:58.255734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:58.259398 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:05:58.259691 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sun Sep 25 01:05:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 (ip 10.222.0.26) !!! Sep 25 01:05:58.273278 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.273774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.274218 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.275063 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.275581 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.276013 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.465384 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:58.476663 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b2571e9e-b70e-46f6-829b-b7a5f0645259 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.225755 Sep 25 01:05:58.477535 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 295/573] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:58 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:58.480186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:58.481607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:58.490588 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.492033 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.492885 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.494193 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:58.495056 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:58.495827 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:58.716625 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:58.732437 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c866fa1e-9fca-4f19-b48c-985464ffd212 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.262103 Sep 25 01:05:58.733320 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 279/574] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:58 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:05:59.522355 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:59.524093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:59.534249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.534771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.535310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:59.536108 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.536630 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.537155 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:59.711130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:05:59.720596 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-231294bb-b2a7-4667-9457-c387a04feaf9 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.205403 Sep 25 01:05:59.721363 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 296/575] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:59 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:05:59.830019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:05:59.831130 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:05:59.842764 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.843626 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.844486 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:05:59.845770 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:05:59.846587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:05:59.847333 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:00.049951 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:00.060886 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ecfb9b91-7ea1-4abf-a15d-c6aa6e41909b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.295648 Sep 25 01:06:00.061519 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 280/576] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:05:59 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:00.748323 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:00.750011 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:00.758968 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:00.759471 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:00.759960 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:00.760764 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:00.761238 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:00.761671 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:01.003164 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:01.013627 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c32bc371-1efa-4072-9d34-20f6dba6472d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.270049 Sep 25 01:06:01.014600 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 297/577] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:00 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:01.086210 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:01.087475 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:01.099157 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:01.100107 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:01.101443 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:01.101887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:01.102745 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:01.102950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:01.314392 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:01.324552 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-84b769c4-4681-412b-91b1-d5fa7e0dfb75 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.243353 Sep 25 01:06:01.325613 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 281/578] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:01 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:02.038223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:02.039191 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:02.042431 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:02.049952 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.050683 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.051283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.052201 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.053457 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.053457 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.283007 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:02.300469 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a0b9ac40-12b3-4a21-9ef5-c2897c0653dd tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.266142 Sep 25 01:06:02.301494 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 298/579] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:02 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:02.352992 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:02.353618 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:02.361751 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.362352 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.363004 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.363767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:02.364222 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:02.364698 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:02.558252 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:02.567895 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-21989b74-9cb5-44f1-a90e-94ce38db0833 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.219467 Sep 25 01:06:02.568657 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 282/580] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:02 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:03.348787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:03.349794 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:03.361907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:03.362777 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:03.363670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:03.364914 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:03.365742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:03.366512 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:03.593942 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:03.594864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:03.602939 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:03.603573 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:03.604134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:03.604982 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:03.605582 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:03.606095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:03.622831 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:03.636850 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e9d75a79-c73b-499b-82c5-c8ec894d5ca6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.299772 Sep 25 01:06:03.637893 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 299/581] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:03 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:03.785100 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:03.795262 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2f713d00-2134-4258-aa52-4671cf611ba5 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.205200 Sep 25 01:06:03.796121 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 283/582] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:03 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:04.675322 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:04.676641 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:04.683576 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:04.684101 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:04.684583 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:04.685348 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:04.685798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:04.686227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:04.823008 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:04.823930 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:04.833838 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:04.834783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:04.836055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:04.837700 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:04.838752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:04.840023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:04.931703 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:04.959841 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d46840db-546b-4b7a-8a21-da1177e9879e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.287910 Sep 25 01:06:04.970271 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 300/583] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:04 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:05.097590 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:05.107899 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d7d53faf-d49f-4ce9-be5d-362cc60243ef tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.289917 Sep 25 01:06:05.109368 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 284/584] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:04 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:05.989482 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:05.990358 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:05.998008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:05.998474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:05.998973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:05.999768 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:06.000298 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:06.000772 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:06.148822 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:06.149773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:06.164302 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:06.165077 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:06.166104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:06.167144 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:06.167840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:06.168295 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:06.252945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:06.270229 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d2fd3f7e-0566-4dc8-a1c1-0f7064ae02ad tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.285455 Sep 25 01:06:06.271691 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 301/585] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:05 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:06.369611 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:06.385053 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1e9ab5fe-b511-4c0e-8ab3-1295dd4294f2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.243029 Sep 25 01:06:06.385970 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 285/586] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:06 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:07.296487 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:07.297150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:07.306180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:07.306826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:07.307367 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:07.308222 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:07.309049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:07.309670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:07.411862 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:07.413905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:07.423086 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:07.423898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:07.424520 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:07.425645 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:07.426372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:07.427109 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:07.526664 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:07.542826 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-969f09ce-e8d2-4254-a28b-ba3688671e48 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.249881 Sep 25 01:06:07.544101 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 302/587] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:07 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:07.637048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:07.648616 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c8f99297-610d-4ea9-af55-c588a3be7f34 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.240905 Sep 25 01:06:07.649509 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 286/588] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:07 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:08.584123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:08.584735 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:08.591391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:08.591876 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:08.592316 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:08.593064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:08.593518 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:08.593944 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:08.675097 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:08.675730 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:08.683559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:08.684211 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:08.684575 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:08.685325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:08.685815 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:08.686229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:08.760202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:08.771137 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-cab0984f-641d-4186-ad64-64fdd75dfa2f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.191102 Sep 25 01:06:08.771746 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 303/589] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:08 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:08.836865 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:08.845718 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3e9d4293-9669-42bf-9ab4-1c68cafff845 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.174757 Sep 25 01:06:08.846313 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 287/590] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:08 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:09.801324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:09.802041 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:09.810418 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:09.811135 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:09.811695 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:09.812729 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:09.813317 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:09.814064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:09.872554 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:09.873666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:09.883548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:09.884243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:09.884783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:09.885622 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:09.886158 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:09.886657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:10.027937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:10.043536 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-88cb65d7-f170-45b4-8385-973c7baf273d tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.246030 Sep 25 01:06:10.045029 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 304/591] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:09 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:10.068725 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:10.085343 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-01fc9bc6-1d58-43dc-9e13-c0ac6bf98117 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.217484 Sep 25 01:06:10.086427 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 288/592] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:09 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:11.068528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:11.069168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:11.077885 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:11.078381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:11.078818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:11.079551 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:11.079995 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:11.080444 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:11.125094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:11.126164 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:11.129935 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=58 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:11.141436 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:11.142205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:11.143005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:11.144314 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:11.145246 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:11.146013 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:11.262019 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:11.271641 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c38c0a21-68f3-4211-b41a-c28bebba69ae tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.206969 Sep 25 01:06:11.272232 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 305/593] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:11 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:11.386211 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:11.394962 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-61632d3c-51aa-4e96-abd0-b4eaa8147d1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.286510 Sep 25 01:06:11.395621 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 289/594] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:11 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:12.309946 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:12.310556 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:12.317890 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.318425 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.318870 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.320139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.320644 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.321083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.324079 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=100 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:12.421585 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:12.422412 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:12.433653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.434523 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.435309 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.436474 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:12.437293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:12.438057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:12.531056 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:12.548731 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d6c975a6-94dc-4dd6-8db5-8778bd0ae744 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1757 microversion: 2.1 time: 0.242672 Sep 25 01:06:12.549895 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 306/595] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:12 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1757 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:12.656092 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:12.666186 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bf9983c1-0b24-4676-8dda-de9cefc7017c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.248561 Sep 25 01:06:12.666960 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 290/596] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:12 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:13.586885 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:13.587742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:13.597025 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.597693 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.598557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.599448 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.600232 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.600371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.691827 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:13.692911 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:13.699756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.700264 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.700753 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.701480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:13.701951 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:13.702384 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:13.779847 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:13.795659 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b2cbd323-cfac-423c-9d79-15e9975f9703 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1760 microversion: 2.1 time: 0.212786 Sep 25 01:06:13.796709 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 307/597] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:13 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1760 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:13.889054 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:13.894094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:13.903265 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-539d0086-65d5-49a7-9c04-d06e210cd564 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1732 microversion: 2.1 time: 0.215337 Sep 25 01:06:13.903871 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 291/598] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:13 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1732 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:14.930846 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:14.932601 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:14.942782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:14.943898 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:14.944497 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:14.945806 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:14.946683 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:14.947475 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.169481 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:15.185291 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-43f9efa8-14d9-4b82-96ca-0a6a6426e38d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1712 microversion: 2.1 time: 0.258634 Sep 25 01:06:15.185291 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 308/599] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:14 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1712 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:15.281998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:15.283112 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:15.292458 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.293272 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.294046 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.295239 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.296032 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.296735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.412259 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] HTTP exception thrown: Cannot 'detach_volume' instance 96a47796-f432-4684-b4da-a8f0fbf960ec while it is in vm_state rescued Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Request method failure captured: Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments/a3f2210d-c752-4d44-b57a-ae5c02fa40f1 HTTP/1.1 Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hKYF4_JwUcbTnW4oRzcy7qEP1dfTBC03wPczp6YeO0UWOgoDHfENsdVRYOxxBcqqOO0s8JXTrZhsw4D9VYMLmNQ7prt1YpRIiMWnbMRoU0pYX2RRAKjC6oQTg0-iMuzBG-yzx2btCP21DnX3Vo36OLBB_Ok4iLN8V_gchQjZhG2kc Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:06:15.414559 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5b11c2ffde89471cafaf35f8579e3ab2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}] Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: ca20e105b76149dd99e4aa64c62eb483 Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:06:15.417301 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Cannot 'detach_volume' instance 96a47796-f432-4684-b4da-a8f0fbf960ec while it is in vm_state rescued Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'server_id': '96a47796-f432-4684-b4da-a8f0fbf960ec', 'id': 'a3f2210d-c752-4d44-b57a-ae5c02fa40f1'} Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 96a47796-f432-4684-b4da-a8f0fbf960ec in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:15.419473 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 96a47796-f432-4684-b4da-a8f0fbf960ec while it is in vm_state rescued Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 96a47796-f432-4684-b4da-a8f0fbf960ec while it is in vm_state rescued Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:15.422639 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Returning 409 to user: Cannot 'detach_volume' instance 96a47796-f432-4684-b4da-a8f0fbf960ec while it is in vm_state rescued {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:15.424973 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2651ceb7-5a62-420e-97eb-b0faecc09ed2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments/a3f2210d-c752-4d44-b57a-ae5c02fa40f1" status: 409 len: 152 microversion: 2.1 time: 0.141119 Sep 25 01:06:15.424973 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 292/600] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:06:15 2022] DELETE /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments/a3f2210d-c752-4d44-b57a-ae5c02fa40f1 => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 25 01:06:15.429751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:15.430303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:15.436830 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.437329 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.437781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.438510 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.438977 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.439415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.548659 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7d61c4f1-758e-4441-9b1e-d92619ab33cb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "POST /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/action" status: 202 len: 0 microversion: 2.1 time: 0.123325 Sep 25 01:06:15.549982 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 309/601] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:06:15 2022] POST /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:06:15.573739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:15.574745 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:15.584846 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.586019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.586595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.587433 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:15.588084 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:15.588755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:15.826327 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:15.837840 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2d162735-d3fa-4192-b91d-be8e8e8ddea9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1720 microversion: 2.1 time: 0.271264 Sep 25 01:06:15.838627 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 293/602] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:15 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1720 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:16.865139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:16.865878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:16.872995 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.873337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.873782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:16.874511 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:16.874976 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:16.875408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:17.033404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:17.042960 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3c6884f0-df6c-4fce-be01-67ef05c7f7c0 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1720 microversion: 2.1 time: 0.182820 Sep 25 01:06:17.045284 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 310/603] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:16 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1720 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:18.079146 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:18.080303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:18.104618 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:18.105502 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:18.106500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:18.107684 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:18.108536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:18.109325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:18.351628 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:18.366257 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-596f2d2c-3903-4d7c-8b08-5ee67be23acb tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1720 microversion: 2.1 time: 0.294316 Sep 25 01:06:18.367376 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 294/604] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:18 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1720 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:19.408522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:19.409516 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:19.430494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:19.431155 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:19.431991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:19.433621 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:19.434794 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:19.435577 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:19.617104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:19.634313 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5ee24ca1-6ed4-4210-b4e7-43b84c353820 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1720 microversion: 2.1 time: 0.231984 Sep 25 01:06:19.635400 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 311/605] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:19 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1720 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:20.672282 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:20.672954 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:20.680791 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.681457 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.682044 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.682852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.683461 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.683936 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.836288 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:20.852275 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a1db51ef-bce5-48ec-8b5a-cf5f3ae665a2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1726 microversion: 2.1 time: 0.183920 Sep 25 01:06:20.853385 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 295/606] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:06:20 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1726 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:06:20.878020 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:20.878655 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:20.886631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.887123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.887562 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.888303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:20.888804 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:20.889353 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:20.978756 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b4430779-6131-4608-8b1b-e94e8fb4a2b2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.104540 Sep 25 01:06:20.979895 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 312/607] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:06:20 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-interface => generated 284 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:06:22.642241 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-a1a12e88-c640-4c90-8668-9e0b3177da2e req-90054077-abff-4f24-9006-416be8525448 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a47796-f432-4684-b4da-a8f0fbf960ec", "tag": "8bf7effb-12ff-4f20-9f6a-7e7a86645f20"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:22.661663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a1a12e88-c640-4c90-8668-9e0b3177da2e req-90054077-abff-4f24-9006-416be8525448 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:22.662153 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a1a12e88-c640-4c90-8668-9e0b3177da2e req-90054077-abff-4f24-9006-416be8525448 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:22.662593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-a1a12e88-c640-4c90-8668-9e0b3177da2e req-90054077-abff-4f24-9006-416be8525448 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:22.675337 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-a1a12e88-c640-4c90-8668-9e0b3177da2e req-90054077-abff-4f24-9006-416be8525448 service nova] Creating event network-changed:8bf7effb-12ff-4f20-9f6a-7e7a86645f20 for instance 96a47796-f432-4684-b4da-a8f0fbf960ec on hv-cinder-maste Sep 25 01:06:22.681416 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-a1a12e88-c640-4c90-8668-9e0b3177da2e req-90054077-abff-4f24-9006-416be8525448 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042950 Sep 25 01:06:22.682023 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 296/608] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:24.699679 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-c2e40507-8439-4f84-b9b7-30bd4f1cb81c req-644aa458-28c1-48b9-8387-acd76e1fcc0a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96a47796-f432-4684-b4da-a8f0fbf960ec", "tag": "8bf7effb-12ff-4f20-9f6a-7e7a86645f20"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:24.711647 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c2e40507-8439-4f84-b9b7-30bd4f1cb81c req-644aa458-28c1-48b9-8387-acd76e1fcc0a service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:24.712262 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c2e40507-8439-4f84-b9b7-30bd4f1cb81c req-644aa458-28c1-48b9-8387-acd76e1fcc0a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:24.712835 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-c2e40507-8439-4f84-b9b7-30bd4f1cb81c req-644aa458-28c1-48b9-8387-acd76e1fcc0a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:24.726821 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-c2e40507-8439-4f84-b9b7-30bd4f1cb81c req-644aa458-28c1-48b9-8387-acd76e1fcc0a service nova] Creating event network-changed:8bf7effb-12ff-4f20-9f6a-7e7a86645f20 for instance 96a47796-f432-4684-b4da-a8f0fbf960ec on hv-cinder-maste Sep 25 01:06:24.733439 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-c2e40507-8439-4f84-b9b7-30bd4f1cb81c req-644aa458-28c1-48b9-8387-acd76e1fcc0a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038068 Sep 25 01:06:24.734112 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 313/609] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:06:49.114573 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=15 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:49.115414 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=26 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:49.438510 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:49.439185 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:49.449868 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.450766 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.451580 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.452928 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.453802 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.454585 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.517690 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc2313b6-eb7c-4fe0-b912-b8a9aa2928c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments/5c3528b1-6407-4cd5-bdc0-0267646c9240" status: 200 len: 194 microversion: 2.20 time: 0.405285 Sep 25 01:06:49.518385 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 297/610] 10.222.0.26 () {60 vars in 1454 bytes} [Sun Sep 25 01:06:49 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments/5c3528b1-6407-4cd5-bdc0-0267646c9240 => generated 194 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 25 01:06:49.605065 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:49.605798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:49.608813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=31 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:49.609662 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=45,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:06:49.623834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.623834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.623834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.623834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.624657 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.624657 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.741448 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lazy-loading 'services' on Instance uuid e3594bb0-3667-44b5-badd-3dcfe8b74c27 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:49.836664 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1e4a96e8-ce38-4c73-9a04-6fca37b59e65 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments/5c3528b1-6407-4cd5-bdc0-0267646c9240" status: 202 len: 0 microversion: 2.20 time: 0.236954 Sep 25 01:06:49.837503 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 314/611] 10.222.0.26 () {60 vars in 1457 bytes} [Sun Sep 25 01:06:49 2022] DELETE /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments/5c3528b1-6407-4cd5-bdc0-0267646c9240 => generated 0 bytes in 239 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:06:49.848186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:49.851383 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:49.861350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.862022 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.862642 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.863698 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:49.864264 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:49.864842 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:49.908572 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7d45fb6a-3106-4d7a-9661-d916cbe0174d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.065139 Sep 25 01:06:49.909182 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 298/612] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Sep 25 01:06:49 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:06:50.924744 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:50.927588 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:50.935700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:50.936203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:50.936679 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:50.937407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:50.937860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:50.938279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:50.978331 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ffcb2bee-9d26-4496-8d69-a883c233e93f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.058747 Sep 25 01:06:50.978925 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 315/613] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Sep 25 01:06:50 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27/os-volume_attachments => generated 25 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:06:51.062929 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:51.064053 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:51.070944 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:51.071418 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:51.071865 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:51.072625 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:51.073076 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:51.073498 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:51.105984 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:06:51.203770 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4aa794fe-a21a-429c-b002-e7ea859ce3ef tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 204 len: 0 microversion: 2.20 time: 0.144608 Sep 25 01:06:51.204801 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 299/614] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Sep 25 01:06:51 2022] DELETE /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:06:51.214422 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:51.215057 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:51.222092 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:51.222620 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:51.223068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:51.223800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:51.224269 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:51.224818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:51.406475 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:51.417297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:51.418752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:51.419945 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2d2c6cd2-29e9-4662-b066-ebd7633e1c6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.210506 Sep 25 01:06:51.420552 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 316/615] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:51 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:06:52.450415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:52.451166 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:52.460350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.461000 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.461464 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.462214 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:52.462671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:52.463105 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:52.643419 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:52.654167 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:52.655897 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:52.657497 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fd4f8a82-e5f9-4c74-bd24-3986677fb799 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.213049 Sep 25 01:06:52.658190 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 300/616] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:52 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:53.695941 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:53.697211 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:53.709691 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.711089 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.711858 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.712794 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:53.713403 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:53.713984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:53.904209 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.919530 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.922318 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:53.924489 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-762e545a-61be-4851-b25d-8116c68c38fa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1722 microversion: 2.20 time: 0.236781 Sep 25 01:06:53.925506 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 317/617] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:53 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1722 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:54.687857 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-6a9f122c-9797-414b-a846-04bdaf75741b req-ef212563-d24c-4f1e-b963-eb6ff9c389c0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e3594bb0-3667-44b5-badd-3dcfe8b74c27", "name": "network-vif-deleted", "tag": "8914da89-09c9-40c1-90d8-87e916c3a872"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:54.707929 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6a9f122c-9797-414b-a846-04bdaf75741b req-ef212563-d24c-4f1e-b963-eb6ff9c389c0 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.708932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6a9f122c-9797-414b-a846-04bdaf75741b req-ef212563-d24c-4f1e-b963-eb6ff9c389c0 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.709732 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-6a9f122c-9797-414b-a846-04bdaf75741b req-ef212563-d24c-4f1e-b963-eb6ff9c389c0 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.736226 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-6a9f122c-9797-414b-a846-04bdaf75741b req-ef212563-d24c-4f1e-b963-eb6ff9c389c0 service nova] Creating event network-vif-deleted:8914da89-09c9-40c1-90d8-87e916c3a872 for instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 on hv-cinder-maste Sep 25 01:06:54.742428 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-6a9f122c-9797-414b-a846-04bdaf75741b req-ef212563-d24c-4f1e-b963-eb6ff9c389c0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.146679 Sep 25 01:06:54.743587 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 301/618] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:06:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:06:54.958238 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:54.959441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:54.980486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.981728 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.983062 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:54.984717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:54.985535 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:54.986292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:55.051391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:55.052264 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:55.053277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:55.054619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lazy-loading 'fault' on Instance uuid e3594bb0-3667-44b5-badd-3dcfe8b74c27 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:06:55.130533 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:55.149359 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:55.153123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:06:55.155450 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-94d06a98-3b80-4752-a35e-ec6fa577b541 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 200 len: 1372 microversion: 2.20 time: 0.204572 Sep 25 01:06:55.156528 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 318/619] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:54 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 1372 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:06:56.189124 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:56.189987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:06:56.198747 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:56.199323 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:56.199815 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:56.200786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:06:56.201307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:06:56.201792 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:06:56.220630 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] HTTP exception thrown: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Request method failure captured: Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 HTTP/1.1 Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hLXqjQc5Z7fgX4Yzky7HVBWL_H1z9hNL0B3utZid7fGPqyRLBCeAbBqP8J0u0BYdLJIKD9w5i62_jK3EY0sbzaTCQ-nzMCBqhVXQp5FbCNC5KaokVDqUxtmw-NqMYY8SsmAkAWsp9l0ZzKO85Qg52c-1P63g8mSZ0qZqHf8TU4tWY Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:06:56.222466 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc51ee9f630a4bc89f1fccbd7ff20c51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}] Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: c468aa6d1248478286fe0a8792411a91 Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:06:56.225524 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'e3594bb0-3667-44b5-badd-3dcfe8b74c27'} Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:06:56.227309 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:06:56.230123 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:06:56.232735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Returning 404 to user: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:06:56.232735 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-65a58ed5-850a-4c39-a75e-68b0e4faa5f7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 404 len: 111 microversion: 2.20 time: 0.039339 Sep 25 01:06:56.232735 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 302/620] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:06:56 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:06:56.237026 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ca25ebaa-53f5-44ef-921f-141f5167e150 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '.version_select at 0x7f118135f9d0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:06:56.268982 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ca25ebaa-53f5-44ef-921f-141f5167e150 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895676118" status: 204 len: 0 microversion: 2.20 time: 0.038273 Sep 25 01:06:56.270015 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 319/621] 10.222.0.26 () {60 vars in 1262 bytes} [Sun Sep 25 01:06:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1895676118 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 25 01:06:57.201595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e50baec3-1bc7-4adf-9b54-0a1dbf9426a4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'create', calling method: .version_select at 0x7f1181294dc0>, body: {"keypair": {"name": "tempest-keypair-630057825", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM89hbR5qgYDfr1RTH5uixuiJncgWyFyTfV1DB3+WZdyi+S92Np7X9z578MbvRLEsBQYyXmkrfsMXMR7eQ8PNNvKWDpzT6GcwfelgXGVCMc8Y5Xl+yjtZunjNxG+Uwu0iw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:57.233110 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-e50baec3-1bc7-4adf-9b54-0a1dbf9426a4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:06:57.241105 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-e50baec3-1bc7-4adf-9b54-0a1dbf9426a4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for user c468aa6d1248478286fe0a8792411a91 and project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:06:57.279417 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e50baec3-1bc7-4adf-9b54-0a1dbf9426a4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.086032 Sep 25 01:06:57.280033 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 303/622] 10.222.0.26 () {62 vars in 1200 bytes} [Sun Sep 25 01:06:57 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 88 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 25 01:06:59.071167 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1872307999", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "aef7bdae-36a0-4057-bbb2-4d50f8f59c75"}], "security_groups": [{"name": "tempest-securitygroup--663520837"}], "key_name": "tempest-keypair-630057825", "user_data": "}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:06:59.205810 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] validate_networks() for [('aef7bdae-36a0-4057-bbb2-4d50f8f59c75', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:07:00.144224 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:07:00.144905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:07:00.145253 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:07:00.145678 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:07:00.146098 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:07:00.156344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.156874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.157429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.158090 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:00.158557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:00.158990 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:00.179890 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:07:00.185381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Getting quotas for user c468aa6d1248478286fe0a8792411a91 and project cc51ee9f630a4bc89f1fccbd7ff20c51. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:07:00.199229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:07:00.201818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:07:00.256339 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e398f6c1-e8c5-4425-b984-a7e1d8705062 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 1.190151 Sep 25 01:07:00.258081 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 320/623] 10.222.0.26 () {62 vars in 1188 bytes} [Sun Sep 25 01:06:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 1193 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 25 01:07:00.272521 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6224f2ee-2207-4aaf-a74c-66e9cdd22c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:00.273594 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6224f2ee-2207-4aaf-a74c-66e9cdd22c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:00.335130 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6224f2ee-2207-4aaf-a74c-66e9cdd22c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:00.343679 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6224f2ee-2207-4aaf-a74c-66e9cdd22c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:00.345290 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6224f2ee-2207-4aaf-a74c-66e9cdd22c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:00.346366 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6224f2ee-2207-4aaf-a74c-66e9cdd22c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1281 microversion: 2.20 time: 0.079315 Sep 25 01:07:00.346931 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 304/624] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:00 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1281 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:01.374092 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-28ba3b0d-6775-47c0-bc5d-724901b9b18a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:01.374985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-28ba3b0d-6775-47c0-bc5d-724901b9b18a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:01.446072 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-28ba3b0d-6775-47c0-bc5d-724901b9b18a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.456223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-28ba3b0d-6775-47c0-bc5d-724901b9b18a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.458218 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-28ba3b0d-6775-47c0-bc5d-724901b9b18a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:01.459789 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-28ba3b0d-6775-47c0-bc5d-724901b9b18a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1281 microversion: 2.20 time: 0.090726 Sep 25 01:07:01.461067 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 321/625] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:01 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1281 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:02.489038 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-14223103-71e5-4a08-a2f0-2aa329ab889a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:02.489953 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-14223103-71e5-4a08-a2f0-2aa329ab889a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:02.549950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-14223103-71e5-4a08-a2f0-2aa329ab889a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:02.565555 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-14223103-71e5-4a08-a2f0-2aa329ab889a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:02.568934 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-14223103-71e5-4a08-a2f0-2aa329ab889a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:02.572116 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-14223103-71e5-4a08-a2f0-2aa329ab889a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1281 microversion: 2.20 time: 0.087275 Sep 25 01:07:02.573365 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 305/626] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:02 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1281 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:03.617858 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0fa0e491-8ef3-49ce-abb0-50fdddd85feb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:03.618474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0fa0e491-8ef3-49ce-abb0-50fdddd85feb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:03.702235 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0fa0e491-8ef3-49ce-abb0-50fdddd85feb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:03.711301 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0fa0e491-8ef3-49ce-abb0-50fdddd85feb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:03.712905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0fa0e491-8ef3-49ce-abb0-50fdddd85feb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:03.714199 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0fa0e491-8ef3-49ce-abb0-50fdddd85feb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1281 microversion: 2.20 time: 0.101089 Sep 25 01:07:03.714892 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 322/627] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:03 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1281 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:04.745082 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:04.745673 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:04.754853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:04.755446 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:04.755927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:04.756713 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:04.757216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:04.757696 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:04.846062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:04.861364 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:04.863029 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:04.867991 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8f24db59-459b-4f54-a11c-b312261e7ccd tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1333 microversion: 2.20 time: 0.126981 Sep 25 01:07:04.869097 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 306/628] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:04 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1333 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:05.910960 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:05.912093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:05.921618 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:05.922118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:05.922570 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:05.923379 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:05.923876 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:05.924307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.009937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:06.020308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:06.024097 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:06.026106 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:06.028951 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:06.031142 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-af0c16f3-1738-4601-b017-1614a380c4c9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1339 microversion: 2.20 time: 0.125404 Sep 25 01:07:06.031775 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.032432 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.033158 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.033312 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 323/629] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:05 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1339 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:06.034326 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.035061 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.035655 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.090576 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e470e862-3fdb-4157-b29c-b77a87b35fb1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.073991 Sep 25 01:07:06.092020 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 307/630] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:06 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:07:06.218970 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:06.219554 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:06.227647 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.228490 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.229230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.230011 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.230690 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.231108 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.270094 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:06.417843 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-739129f6-c47c-4dd9-a6ab-747a0b425692 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 204 len: 0 microversion: 2.1 time: 0.201880 Sep 25 01:07:06.419216 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 324/631] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:06 2022] DELETE /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:07:06.435047 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:06.435950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:06.453139 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.454213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.455364 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.457769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:06.459039 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:06.460006 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:06.676217 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:06.687087 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-77169e89-f4a8-41b4-8984-31a1931e1a4a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1672 microversion: 2.1 time: 0.258775 Sep 25 01:07:06.687963 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 308/632] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:06 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1672 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:07.086175 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:07.087086 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:07.094564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:07.095068 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:07.095522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:07.096279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:07.096816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:07.097258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:07.250103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:07.260485 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:07.261874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:07.263236 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2d842f43-812c-4416-a972-5d20315ed519 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.182029 Sep 25 01:07:07.263809 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 325/633] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:07 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:07.729867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:07.730881 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:07.739257 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:07.739757 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:07.740203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:07.740968 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:07.741465 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:07.741902 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.015262 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:08.040178 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3db1377a-4b0d-4853-8ced-30d1bb0ee3fb tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1672 microversion: 2.1 time: 0.315349 Sep 25 01:07:08.041177 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 309/634] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:07 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1672 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:08.290444 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:08.291736 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:08.299846 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.300546 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.301060 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.301855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.302326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.304058 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.344918 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-f9cdcbd0-de0a-4221-9d80-256648272bbf req-dc2c708a-9da5-4587-8196-47d6e6c98b03 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860527d0-4a7d-421f-8326-1d565c5f9f8f", "tag": "47b9f80d-5f51-4b6e-ba3a-7dc7fe295721"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:08.377202 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-f9cdcbd0-de0a-4221-9d80-256648272bbf req-dc2c708a-9da5-4587-8196-47d6e6c98b03 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:08.378467 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-f9cdcbd0-de0a-4221-9d80-256648272bbf req-dc2c708a-9da5-4587-8196-47d6e6c98b03 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:08.379548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-f9cdcbd0-de0a-4221-9d80-256648272bbf req-dc2c708a-9da5-4587-8196-47d6e6c98b03 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:08.409126 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-f9cdcbd0-de0a-4221-9d80-256648272bbf req-dc2c708a-9da5-4587-8196-47d6e6c98b03 service nova] Creating event network-changed:47b9f80d-5f51-4b6e-ba3a-7dc7fe295721 for instance 860527d0-4a7d-421f-8326-1d565c5f9f8f on hv-cinder-maste Sep 25 01:07:08.423277 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-f9cdcbd0-de0a-4221-9d80-256648272bbf req-dc2c708a-9da5-4587-8196-47d6e6c98b03 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089739 Sep 25 01:07:08.424800 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 310/635] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:08.544574 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:08.559780 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:08.562452 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:08.564828 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-802d4c37-54c6-452f-be85-63191f35a2d6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.278739 Sep 25 01:07:08.565992 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 326/636] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:08 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:09.087430 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:09.089077 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:09.101283 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.102235 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.103057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.104422 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.105327 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.106193 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.474603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:09.490349 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-da57324f-1070-4892-86a2-b33775b6ef70 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1672 microversion: 2.1 time: 0.412002 Sep 25 01:07:09.491521 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 311/637] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:09 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1672 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:09.611316 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:09.612152 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:09.623227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.623948 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.624615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.625564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:09.626404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:09.627206 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:09.808940 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:09.826031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:09.829268 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:09.842542 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ba3a227c-b321-40b8-849d-c2ae957be85a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.227015 Sep 25 01:07:09.843804 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 327/638] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:09 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:10.461614 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-1043be7f-c909-4c54-bc6d-b43d34f4c576 req-9a76552c-5b10-47f3-be43-136e6b99c711 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "16136bd2-3934-43b5-a833-3025f5bc3079", "name": "network-vif-deleted", "tag": "e011ed57-3944-4741-9919-d93dc1c35378"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:10.472973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1043be7f-c909-4c54-bc6d-b43d34f4c576 req-9a76552c-5b10-47f3-be43-136e6b99c711 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.473611 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1043be7f-c909-4c54-bc6d-b43d34f4c576 req-9a76552c-5b10-47f3-be43-136e6b99c711 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.474160 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-1043be7f-c909-4c54-bc6d-b43d34f4c576 req-9a76552c-5b10-47f3-be43-136e6b99c711 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.487323 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-1043be7f-c909-4c54-bc6d-b43d34f4c576 req-9a76552c-5b10-47f3-be43-136e6b99c711 service nova] Creating event network-vif-deleted:e011ed57-3944-4741-9919-d93dc1c35378 for instance 16136bd2-3934-43b5-a833-3025f5bc3079 on hv-cinder-maste Sep 25 01:07:10.496766 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-1043be7f-c909-4c54-bc6d-b43d34f4c576 req-9a76552c-5b10-47f3-be43-136e6b99c711 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041961 Sep 25 01:07:10.497550 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 312/639] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:10.523415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:10.524813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:10.528553 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:10.537823 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.538388 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.538854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.539637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.540140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.540649 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.633182 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:10.643893 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-62a2a7de-9293-45bf-b483-9fafafcf70c7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1606 microversion: 2.1 time: 0.127710 Sep 25 01:07:10.644780 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 328/640] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:10 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1606 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:10.888196 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:10.889026 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:10.895925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.896503 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.896910 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:10.898165 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:10.898657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:10.899045 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.068276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.080860 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.082587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.083794 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6e30e823-2ca0-4128-9af5-3aff869783aa tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.200960 Sep 25 01:07:11.084980 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 313/641] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:10 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:11.687619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:11.688593 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:11.696723 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.697228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.697685 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.698559 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:11.698988 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:11.699699 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:11.819131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:11.836606 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-93c78789-5e92-4718-bfdc-eb1d82e53c54 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 200 len: 1606 microversion: 2.1 time: 0.154560 Sep 25 01:07:11.837992 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 329/642] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:11 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 1606 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:12.115661 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:12.118388 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:12.133641 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.134703 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.135299 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.137080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.138827 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.139622 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.424086 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:12.433436 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:12.434955 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:12.436154 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-79b0f081-4b68-40b4-b27d-2684f5c60f2f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.328478 Sep 25 01:07:12.436771 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 314/643] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:12 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:12.876227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:12.877148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:12.884754 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.885259 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.885701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.886441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:12.886905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:12.887345 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:12.904235 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] HTTP exception thrown: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Request method failure captured: Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 HTTP/1.1 Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6g-7R0NPGHnQh-AAfy2wownMEYKMsEkV4BwlpcwarLcgg2BodtBWUGVihfShwYOQcR49baCvI_KJmt4wpQ89LJ3-SyTkCIi7Prd6XftE7SGDhcUrkH0uZzY5HDM_NiyinYiO9oNi5RQb9i-4dKKgYyp319I8sslS-81S1K6IgEk9co Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:07:12.906285 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_537d0a114f314e9b948150001bda642c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/537d0a114f314e9b948150001bda642c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}] Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: f32c9b07e6234d55b0d4846d44ee6ce6 Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:07:12.909262 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '16136bd2-3934-43b5-a833-3025f5bc3079'} Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:12.910864 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:07:12.913208 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:12.915161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Returning 404 to user: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:12.915161 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7ba5afc2-483b-4b99-bb7a-037f77ab1175 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 404 len: 111 microversion: 2.1 time: 0.037076 Sep 25 01:07:12.915161 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 330/644] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:12 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:12.921373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0920df99-55aa-4b2f-905d-56b3eb284418 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '.version_select at 0x7f11812bd310>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:12.928998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=8 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:12.950198 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0920df99-55aa-4b2f-905d-56b3eb284418 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-206421709" status: 202 len: 0 microversion: 2.1 time: 0.032880 Sep 25 01:07:12.950925 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 315/645] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Sep 25 01:07:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-206421709 => generated 0 bytes in 35 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:07:13.469245 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:13.470923 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:13.493101 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:13.494664 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:13.495417 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:13.497002 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:13.497602 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:13.498805 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:13.707229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=10 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:13.748414 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:13.770617 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:13.774671 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:13.778828 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c77472f4-2d25-4337-a3d1-dac9f867eabf tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.314582 Sep 25 01:07:13.781321 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 331/646] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:13 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:13.960343 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c29f60b5-d355-49b0-93a0-57d80664e83e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'create', calling method: .version_select at 0x7f118126e700>, body: {"keypair": {"name": "tempest-keypair-746516293", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBApORI+pyfFn0yQRI+SJWU2V6YlxmJURsZakriCOlatv4jbyMma9JXD69aYiVfqHzg1BlykL9UMwFw+E1G9coCajakT7BEmcts6C0y7m3iSYPmOEW8Xtd86c9QpcPJ8dqA=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:13.979380 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-c29f60b5-d355-49b0-93a0-57d80664e83e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for project 537d0a114f314e9b948150001bda642c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:07:13.984546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-c29f60b5-d355-49b0-93a0-57d80664e83e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for user f32c9b07e6234d55b0d4846d44ee6ce6 and project 537d0a114f314e9b948150001bda642c. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:07:14.012894 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c29f60b5-d355-49b0-93a0-57d80664e83e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.057215 Sep 25 01:07:14.013555 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 316/647] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:07:13 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:14.829069 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:14.830353 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:14.840838 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:14.841339 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:14.841965 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:14.842498 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:14.843006 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:14.843911 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:14.849340 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:15.188210 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:15.202752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:15.206245 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:15.208777 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2682fd7c-32b2-4638-bb3c-85fab376d3a9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.387388 Sep 25 01:07:15.210552 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 332/648] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:14 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:15.694626 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:15.695476 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:15.703019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:15.703829 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:15.704410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:15.705104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:15.705601 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:15.706178 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:15.739154 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f63f61aa-47e7-4f66-80be-7a0f5e52aa63 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c/ips" status: 200 len: 148 microversion: 2.1 time: 0.050215 Sep 25 01:07:15.750921 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 317/649] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:07:15 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c/ips => generated 148 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:15.762441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8d3d31e3-87b2-4508-8364-3908521ab87d"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:15.766094 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:15.777545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:15.778333 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:15.779130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:15.780536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:15.781311 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:15.782083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:15.968234 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Invalid volume: volume 8d3d31e3-87b2-4508-8364-3908521ab87d is already attached to instances: 7d9d047b-1796-4f02-96c1-94e475e3b55e Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: POST /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c/os-volume_attachments HTTP/1.1 Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 74 Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:07:15.973548 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: {"volumeAttachment": {"volumeId": "8d3d31e3-87b2-4508-8364-3908521ab87d"}} Sep 25 01:07:15.976810 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Invalid volume: volume 8d3d31e3-87b2-4508-8364-3908521ab87d is already attached to instances: 7d9d047b-1796-4f02-96c1-94e475e3b55e Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'server_id': 'b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c', 'body': {'volumeAttachment': {'volumeId': '8d3d31e3-87b2-4508-8364-3908521ab87d'}}} Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 8d3d31e3-87b2-4508-8364-3908521ab87d is already attached to instances: 7d9d047b-1796-4f02-96c1-94e475e3b55e Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.978417 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 8d3d31e3-87b2-4508-8364-3908521ab87d is already attached to instances: 7d9d047b-1796-4f02-96c1-94e475e3b55e Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:15.981093 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:15.986393 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:15.986393 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:15.986393 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:15.986393 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 8d3d31e3-87b2-4508-8364-3908521ab87d is already attached to instances: 7d9d047b-1796-4f02-96c1-94e475e3b55e Sep 25 01:07:15.986393 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:15.986393 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 400 to user: Invalid volume: volume 8d3d31e3-87b2-4508-8364-3908521ab87d is already attached to instances: 7d9d047b-1796-4f02-96c1-94e475e3b55e {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:15.988707 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-624a4533-1035-454f-a7c2-c276495554a3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.235487 Sep 25 01:07:15.989668 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 333/650] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:07:15 2022] POST /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c/os-volume_attachments => generated 174 bytes in 238 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:07:16.000469 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:16.000994 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:16.010450 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.011018 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.011609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.012528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.015657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.016339 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.087990 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:16.194230 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:16.227653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-9928225d-f655-4f82-a0fa-c67c6962ef05 req-c5e60507-f9dd-4ed6-981c-1892a3c5dd88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860527d0-4a7d-421f-8326-1d565c5f9f8f", "name": "network-vif-plugged", "status": "completed", "tag": "47b9f80d-5f51-4b6e-ba3a-7dc7fe295721"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:16.250836 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9928225d-f655-4f82-a0fa-c67c6962ef05 req-c5e60507-f9dd-4ed6-981c-1892a3c5dd88 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.251776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9928225d-f655-4f82-a0fa-c67c6962ef05 req-c5e60507-f9dd-4ed6-981c-1892a3c5dd88 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.254476 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9928225d-f655-4f82-a0fa-c67c6962ef05 req-c5e60507-f9dd-4ed6-981c-1892a3c5dd88 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.298433 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-9928225d-f655-4f82-a0fa-c67c6962ef05 req-c5e60507-f9dd-4ed6-981c-1892a3c5dd88 service nova] Creating event network-vif-plugged:47b9f80d-5f51-4b6e-ba3a-7dc7fe295721 for instance 860527d0-4a7d-421f-8326-1d565c5f9f8f on hv-cinder-maste Sep 25 01:07:16.309574 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-9928225d-f655-4f82-a0fa-c67c6962ef05 req-c5e60507-f9dd-4ed6-981c-1892a3c5dd88 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.220623 Sep 25 01:07:16.312708 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 334/651] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:16.321185 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-74eb73db-2872-43e5-9145-fd2f8642be5e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 204 len: 0 microversion: 2.1 time: 0.323369 Sep 25 01:07:16.327773 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 318/652] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:15 2022] DELETE /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 0 bytes in 328 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:16.331129 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:16.333107 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:16.342028 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:16.343712 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:16.348208 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.349116 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.350465 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.352039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.352881 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.353604 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.358530 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.359834 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.361358 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.362767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:16.363767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:16.364676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:16.570035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:16.580567 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:16.588019 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:16.591331 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:16.591534 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d86af44e-a09b-4683-8926-c05e93d634db tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1679 microversion: 2.1 time: 0.261636 Sep 25 01:07:16.592245 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 319/653] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:16 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1679 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:16.594279 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7b83ef39-fdca-4fbe-8bd7-adfd7d13b704 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.276126 Sep 25 01:07:16.594991 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 335/654] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:16 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:16.600935 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-515828083", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5a07d1e6-846e-499e-b152-bff6ad0aa419"}], "security_groups": [{"name": "tempest-securitygroup--1848126446"}], "key_name": "tempest-keypair-746516293", "user_data": "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:16.753742 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] validate_networks() for [('5a07d1e6-846e-499e-b152-bff6ad0aa419', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:07:17.326804 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:07:17.327358 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:07:17.327977 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:07:17.328708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:07:17.329338 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:07:17.341890 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.342633 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.343092 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.343891 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.344566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.345437 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.366446 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for project 537d0a114f314e9b948150001bda642c. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:07:17.371695 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Getting quotas for user f32c9b07e6234d55b0d4846d44ee6ce6 and project 537d0a114f314e9b948150001bda642c. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:07:17.392311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:07:17.397360 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:07:17.419425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=2,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:17.472116 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR oslo.messaging._drivers.impl_rabbit [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [bf4e9500-bd44-4794-a721-cd29ac9d30f4] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:07:17.638715 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:17.639546 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:17.647670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.648168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.648651 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.649381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.649849 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.650280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.860750 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.871007 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.872529 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:17.873698 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-fcd4887d-2440-4b9a-a19c-21e021f4a403 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.241538 Sep 25 01:07:17.874513 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 336/655] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:17 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:17.879537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:17.880164 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:17.887541 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.888127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.888611 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:17.889332 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:17.889792 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:17.890372 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:18.057712 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:18.074213 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-27b69714-ca12-4306-adf6-99851a1fb68d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1679 microversion: 2.1 time: 0.198609 Sep 25 01:07:18.074957 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 337/656] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:17 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1679 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:18.483795 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [bf4e9500-bd44-4794-a721-cd29ac9d30f4] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 56226. Sep 25 01:07:18.493220 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-32933b0d-287f-441b-a8a2-57a569106cdc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.899281 Sep 25 01:07:18.494703 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 320/657] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:07:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 1902 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:07:18.514859 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ee8b4f06-7385-4b41-94eb-9abf323f33ad tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:18.516221 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ee8b4f06-7385-4b41-94eb-9abf323f33ad tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:18.594938 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ee8b4f06-7385-4b41-94eb-9abf323f33ad tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:18.605526 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ee8b4f06-7385-4b41-94eb-9abf323f33ad tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1236 microversion: 2.1 time: 0.098101 Sep 25 01:07:18.607095 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 338/658] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:18 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1236 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:18.902066 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:18.902860 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:18.910373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:18.911055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:18.911609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:18.912542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:18.913081 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:18.913585 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.114157 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:19.114907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:19.122886 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.123490 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.123944 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.124719 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.125189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.125617 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.139972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.151008 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.152703 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.154641 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d8e3f421-11d7-419e-bf30-a502776ca11b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.256807 Sep 25 01:07:19.167120 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 321/659] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:18 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:19.282203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.291525 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4bd6401e-b450-46bc-9cc7-f99ef0df04c7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1679 microversion: 2.1 time: 0.182802 Sep 25 01:07:19.292605 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 339/660] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:19 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1679 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:19.637817 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:19.639168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:19.651241 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.652049 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.652652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.653748 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.654509 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.655111 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.820083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-f4e05c94-b8a2-4a0a-b5d2-36d7d258569b req-e05fd15b-d6f1-48b9-a768-8fdd255b3a29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c", "name": "network-vif-deleted", "tag": "a0c93e14-68e0-4dbc-bfab-09f855f4fda1"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:19.821935 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:19.844330 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3d2fd8e7-e7f0-4038-a998-f654b612cb4b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1232 microversion: 2.1 time: 0.215694 Sep 25 01:07:19.847515 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 322/661] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:19 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1232 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:19.855393 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=80,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:19.871573 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f4e05c94-b8a2-4a0a-b5d2-36d7d258569b req-e05fd15b-d6f1-48b9-a768-8fdd255b3a29 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:19.872694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f4e05c94-b8a2-4a0a-b5d2-36d7d258569b req-e05fd15b-d6f1-48b9-a768-8fdd255b3a29 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:19.873552 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f4e05c94-b8a2-4a0a-b5d2-36d7d258569b req-e05fd15b-d6f1-48b9-a768-8fdd255b3a29 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:19.901298 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-f4e05c94-b8a2-4a0a-b5d2-36d7d258569b req-e05fd15b-d6f1-48b9-a768-8fdd255b3a29 service nova] Creating event network-vif-deleted:a0c93e14-68e0-4dbc-bfab-09f855f4fda1 for instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c on hv-cinder-maste Sep 25 01:07:19.914183 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-f4e05c94-b8a2-4a0a-b5d2-36d7d258569b req-e05fd15b-d6f1-48b9-a768-8fdd255b3a29 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.099056 Sep 25 01:07:19.915318 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 340/662] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:20.180279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:20.181012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:20.191717 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.192699 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.193993 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.195213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.196145 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.196783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.328854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:20.330961 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:20.347647 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.348146 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.349284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.351286 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.352015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.353233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.395443 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:20.411994 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:20.415412 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:20.417986 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bf978c6f-4a2f-49c9-8c13-03abcf375e33 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1406 microversion: 2.20 time: 0.242881 Sep 25 01:07:20.419297 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 323/663] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:20 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1406 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:07:20.449244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:20.458364 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-58dfd115-779d-424e-b2cf-4eb451be8c11 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1611 microversion: 2.1 time: 0.145222 Sep 25 01:07:20.460119 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 341/664] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:20 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1611 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:20.890062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:20.891105 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:20.900422 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.901087 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.907394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:20.908472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:20.909104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:20.909679 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.044013 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:21.059160 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7ea6237c-f633-4999-b186-81f5f830f703 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1288 microversion: 2.1 time: 0.173711 Sep 25 01:07:21.067545 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 324/665] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:20 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1288 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:21.109732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-225754052"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:21.110284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:21.123077 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.123508 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.123958 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.124751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.125356 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.125798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.303398 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.network.security_group_api [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Removing security group 49ef2f1a-9078-4029-80d5-220fef05b5de from port 25ea87eb-7543-4aed-9085-17cbcf974eb9 Sep 25 01:07:21.450133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:21.463204 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:21.486905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.487905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.488823 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:21.490833 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:21.491810 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:21.492792 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.015468 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3194a750-c0db-4822-af94-9bfee29c2c86 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/action" status: 202 len: 0 microversion: 2.1 time: 0.909747 Sep 25 01:07:22.016686 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.018552 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 342/666] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:07:21 2022] POST /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/action => generated 0 bytes in 914 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:07:22.025667 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:22.026546 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:22.029953 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.031631 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.032925 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7b02414d-5b19-45c8-a4d2-3a169220fcf0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1596 microversion: 2.20 time: 0.590991 Sep 25 01:07:22.033525 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 325/667] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:07:21 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1596 bytes in 593 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:07:22.050593 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.054184 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.054978 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.055927 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.059669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.060591 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.144457 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.145548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.147458 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.148671 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lazy-loading 'fault' on Instance uuid b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:22.185479 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-278c68f3-983c-4f45-aa90-920890b0d477 req-8f554a45-074f-4c16-a34d-d4ce41d1f897 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731a9677-0b93-4792-819c-b75b56c0f5b1", "tag": "25ea87eb-7543-4aed-9085-17cbcf974eb9"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:22.204663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-278c68f3-983c-4f45-aa90-920890b0d477 req-8f554a45-074f-4c16-a34d-d4ce41d1f897 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.208432 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-278c68f3-983c-4f45-aa90-920890b0d477 req-8f554a45-074f-4c16-a34d-d4ce41d1f897 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.210168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-278c68f3-983c-4f45-aa90-920890b0d477 req-8f554a45-074f-4c16-a34d-d4ce41d1f897 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.245518 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.246438 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-278c68f3-983c-4f45-aa90-920890b0d477 req-8f554a45-074f-4c16-a34d-d4ce41d1f897 service nova] Creating event network-changed:25ea87eb-7543-4aed-9085-17cbcf974eb9 for instance 731a9677-0b93-4792-819c-b75b56c0f5b1 on hv-cinder-maste Sep 25 01:07:22.261620 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-278c68f3-983c-4f45-aa90-920890b0d477 req-8f554a45-074f-4c16-a34d-d4ce41d1f897 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.197783 Sep 25 01:07:22.262248 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 326/668] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:22.269450 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-28f82745-1596-4be3-a241-2a1d7f6aebc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 200 len: 1330 microversion: 2.1 time: 0.249043 Sep 25 01:07:22.281957 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 343/669] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:22 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 1330 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:22.304326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:22.305117 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:22.306844 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:22.307255 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:22.317393 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.317927 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.319180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.319966 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.320461 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.320921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.328811 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.330234 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.331043 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.332731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:22.334090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:22.335808 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:22.455896 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:22.481167 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7eac893c-436d-4c9b-a99f-b9cb3e0cc444 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1294 microversion: 2.1 time: 0.195433 Sep 25 01:07:22.483073 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 344/670] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:22 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1294 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:22.493539 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9b6cea4a-833c-4f59-952b-4f3ef640442c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.219602 Sep 25 01:07:22.494802 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 327/671] 10.222.0.26 () {60 vars in 1316 bytes} [Sun Sep 25 01:07:22 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-interface => generated 284 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:07:23.311978 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:23.312831 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:23.320278 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.320795 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.321440 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.322372 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.323101 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.323712 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.341048 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c HTTP/1.1 Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:07:23.343103 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:07:23.344640 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': 'b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c'} Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:23.345394 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:07:23.346578 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:23.347691 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:23.347691 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8388b177-c645-4812-a90d-67604d42501e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 404 len: 111 microversion: 2.1 time: 0.038473 Sep 25 01:07:23.348690 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 345/672] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:23 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:23.364716 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4e5f7c6d-6638-4d2d-8fb7-adfbe2786e86 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '.version_select at 0x7f118126e700>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:23.405082 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4e5f7c6d-6638-4d2d-8fb7-adfbe2786e86 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-400587366" status: 202 len: 0 microversion: 2.1 time: 0.048368 Sep 25 01:07:23.407081 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 328/673] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Sep 25 01:07:23 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-400587366 => generated 0 bytes in 52 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:07:23.528252 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:23.529875 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:23.540029 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.540826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.541561 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.542970 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:23.543813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:23.544836 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:23.689968 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:23.707370 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-91c5ccc8-c412-48bc-9e02-ca26533c535f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1294 microversion: 2.1 time: 0.183654 Sep 25 01:07:23.721189 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 346/674] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:23 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1294 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:24.735743 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:24.736321 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:24.746975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:24.747480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:24.747927 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:24.748716 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:24.749205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:24.749786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.277932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:25.304541 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b855b8a9-f494-43bb-bc44-0c3494d3269a tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.572981 Sep 25 01:07:25.324634 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 329/675] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:24 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 592 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:25.325586 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-ebeabedd-dc07-4312-9fd2-781ba0ef41c8 req-658b69d7-1759-402c-9d17-1c8bc0b42094 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "860527d0-4a7d-421f-8326-1d565c5f9f8f", "tag": "47b9f80d-5f51-4b6e-ba3a-7dc7fe295721"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:25.337579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-ebeabedd-dc07-4312-9fd2-781ba0ef41c8 req-658b69d7-1759-402c-9d17-1c8bc0b42094 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.338372 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-ebeabedd-dc07-4312-9fd2-781ba0ef41c8 req-658b69d7-1759-402c-9d17-1c8bc0b42094 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.339004 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-ebeabedd-dc07-4312-9fd2-781ba0ef41c8 req-658b69d7-1759-402c-9d17-1c8bc0b42094 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.357588 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-ebeabedd-dc07-4312-9fd2-781ba0ef41c8 req-658b69d7-1759-402c-9d17-1c8bc0b42094 service nova] Creating event network-changed:47b9f80d-5f51-4b6e-ba3a-7dc7fe295721 for instance 860527d0-4a7d-421f-8326-1d565c5f9f8f on hv-cinder-maste Sep 25 01:07:25.363612 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-ebeabedd-dc07-4312-9fd2-781ba0ef41c8 req-658b69d7-1759-402c-9d17-1c8bc0b42094 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049443 Sep 25 01:07:25.364988 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 347/676] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:25.487129 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:25.488134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:25.499394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.500712 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.501827 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.504179 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.506027 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.507089 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.643776 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lazy-loading 'services' on Instance uuid 731a9677-0b93-4792-819c-b75b56c0f5b1 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:25.750376 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ca071198-31b5-4a6a-860d-dc552bc1201b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "DELETE /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments/56bf6181-fd3c-4da0-a938-c18036c7ab41" status: 202 len: 0 microversion: 2.1 time: 0.267725 Sep 25 01:07:25.752127 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 330/677] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:07:25 2022] DELETE /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments/56bf6181-fd3c-4da0-a938-c18036c7ab41 => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:07:25.764745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:25.774294 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:25.783656 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.785265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.786059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.787214 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:25.788070 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:25.789018 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:25.840535 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-656927c8-386f-4b3a-91e4-e928489d07e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.083109 Sep 25 01:07:25.842162 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 348/678] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:25 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments => generated 197 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:26.335557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:26.337446 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:26.366247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.368001 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.369268 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.371289 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.373024 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.374429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.708989 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:26.713756 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:26.752010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.752010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.752010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.759473 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.760355 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.761230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.812186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:26.828332 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8eb1691d-d554-4ca2-962e-834bee1e40b0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.501412 Sep 25 01:07:26.841396 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 331/679] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:26 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:26.856553 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:26.859162 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:26.874432 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.875112 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.875399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.876195 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:26.876704 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:26.877145 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:26.996715 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fe8f4dbc-285a-4345-9b00-42943b55d488 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.143263 Sep 25 01:07:27.000799 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 332/680] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:26 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments => generated 197 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:27.022831 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lazy-loading 'services' on Instance uuid 7d9d047b-1796-4f02-96c1-94e475e3b55e {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:27.083773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-e2f70016-3fa7-473c-bfe2-a43c0dd2072b req-ddc35bd7-934b-46d8-807d-9832c04510e1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bda589-bfa8-4622-82e5-e6abb0298a27", "tag": "97378db9-6dd7-40b9-aa76-d8f70e6836fa"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:27.097403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e2f70016-3fa7-473c-bfe2-a43c0dd2072b req-ddc35bd7-934b-46d8-807d-9832c04510e1 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:27.098551 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e2f70016-3fa7-473c-bfe2-a43c0dd2072b req-ddc35bd7-934b-46d8-807d-9832c04510e1 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:27.100139 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e2f70016-3fa7-473c-bfe2-a43c0dd2072b req-ddc35bd7-934b-46d8-807d-9832c04510e1 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:27.122521 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-e2f70016-3fa7-473c-bfe2-a43c0dd2072b req-ddc35bd7-934b-46d8-807d-9832c04510e1 service nova] Creating event network-changed:97378db9-6dd7-40b9-aa76-d8f70e6836fa for instance 24bda589-bfa8-4622-82e5-e6abb0298a27 on hv-cinder-maste Sep 25 01:07:27.132837 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-e2f70016-3fa7-473c-bfe2-a43c0dd2072b req-ddc35bd7-934b-46d8-807d-9832c04510e1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053330 Sep 25 01:07:27.134334 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 333/681] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:27.247152 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3a1708bc-3b49-4959-84ac-0ea3db58d745 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments/8d3d31e3-87b2-4508-8364-3908521ab87d" status: 202 len: 0 microversion: 2.1 time: 0.547863 Sep 25 01:07:27.248434 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 349/682] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:07:26 2022] DELETE /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments/8d3d31e3-87b2-4508-8364-3908521ab87d => generated 0 bytes in 551 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:07:27.276426 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:27.293296 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:27.313151 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:27.313956 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:27.314670 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:27.316693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:27.320862 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:27.321633 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:27.365057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:27.398824 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-f72b4f9c-efad-4e6c-a974-8591cf20edff req-2ceb15f0-2588-46ba-9e21-0ccec33aeff8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "731a9677-0b93-4792-819c-b75b56c0f5b1", "tag": "25ea87eb-7543-4aed-9085-17cbcf974eb9"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:27.412005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=10 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:27.449303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f72b4f9c-efad-4e6c-a974-8591cf20edff req-2ceb15f0-2588-46ba-9e21-0ccec33aeff8 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:27.450161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f72b4f9c-efad-4e6c-a974-8591cf20edff req-2ceb15f0-2588-46ba-9e21-0ccec33aeff8 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:27.451833 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f72b4f9c-efad-4e6c-a974-8591cf20edff req-2ceb15f0-2588-46ba-9e21-0ccec33aeff8 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:27.481795 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-f72b4f9c-efad-4e6c-a974-8591cf20edff req-2ceb15f0-2588-46ba-9e21-0ccec33aeff8 service nova] Creating event network-changed:25ea87eb-7543-4aed-9085-17cbcf974eb9 for instance 731a9677-0b93-4792-819c-b75b56c0f5b1 on hv-cinder-maste Sep 25 01:07:27.484417 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fd0bbdb7-a13f-4c67-a0a1-7913fb925ad8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.226511 Sep 25 01:07:27.490491 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-f72b4f9c-efad-4e6c-a974-8591cf20edff req-2ceb15f0-2588-46ba-9e21-0ccec33aeff8 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096618 Sep 25 01:07:27.496914 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 350/683] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:27.510476 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 334/684] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:27 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments => generated 197 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:27.857392 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:27.858303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:27.866980 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:27.867485 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:27.867932 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:27.868822 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:27.869670 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:27.870365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.017244 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:28.019967 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:28.032301 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.033373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.034376 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.036031 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.037656 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.039041 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.053866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:28.072612 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0c6288c1-cf7b-4c7f-a701-442fbbfb0e41 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.219485 Sep 25 01:07:28.075200 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 351/685] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:27 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:28.086658 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-95fa206e-dd71-46be-add5-5ab479336890 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.074172 Sep 25 01:07:28.087596 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 335/686] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:28 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments => generated 25 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:07:28.103615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:28.105086 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:28.113244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.113853 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.114526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.115205 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.115668 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.116284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.137676 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:28.227755 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] HTTP exception thrown: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 is not attached to volume 56bf6181-fd3c-4da0-a938-c18036c7ab41 Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Request method failure captured: Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: DELETE /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments/56bf6181-fd3c-4da0-a938-c18036c7ab41 HTTP/1.1 Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6i7zT_134PvVSsgwvf5AU4iTDCV7wD9BuILjlM9e30_bqPiziFIaGIMlL72PVpT--eF8QOCnd5_mTrlgcbsPDXBZP7tc-sBN8VjYRdtqXVZbHLoH5wiOsCENdpgD7O4-Uavq-bmpSHVPx3DaeblarhkqspH4Er9M4lclbG0cdBKbSM Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: a49eb5e19c0e44b3b9273f5126c0915f Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-TestMinimumBasicScenario-574361902 Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:07:28.232424 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a49eb5e19c0e44b3b9273f5126c0915f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a49eb5e19c0e44b3b9273f5126c0915f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a49eb5e19c0e44b3b9273f5126c0915f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a49eb5e19c0e44b3b9273f5126c0915f"}]}] Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-TestMinimumBasicScenario-574361902 Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: a49eb5e19c0e44b3b9273f5126c0915f Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-TestMinimumBasicScenario-574361902 Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-TestMinimumBasicScenario-574361902-project Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 1bc4010eab744cf78053adb904f85dc5 Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-TestMinimumBasicScenario-574361902-project Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:07:28.235274 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 is not attached to volume 56bf6181-fd3c-4da0-a938-c18036c7ab41 Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'server_id': '731a9677-0b93-4792-819c-b75b56c0f5b1', 'id': '56bf6181-fd3c-4da0-a938-c18036c7ab41'} Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 56bf6181-fd3c-4da0-a938-c18036c7ab41. Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:28.236801 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 is not attached to volume 56bf6181-fd3c-4da0-a938-c18036c7ab41 Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 is not attached to volume 56bf6181-fd3c-4da0-a938-c18036c7ab41 Sep 25 01:07:28.238700 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:28.241615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Returning 404 to user: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 is not attached to volume 56bf6181-fd3c-4da0-a938-c18036c7ab41 {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:28.243043 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8d3d676e-9b50-44e5-86cc-2c8c14ec4823 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "DELETE /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments/56bf6181-fd3c-4da0-a938-c18036c7ab41" status: 404 len: 154 microversion: 2.1 time: 0.144916 Sep 25 01:07:28.248569 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 352/687] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:07:28 2022] DELETE /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1/os-volume_attachments/56bf6181-fd3c-4da0-a938-c18036c7ab41 => generated 154 bytes in 151 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:28.519564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:28.522845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:28.530488 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.531048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.531490 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.532229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.532730 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.533159 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.580163 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7e25cedd-613d-4432-8435-ed2a4abacfdf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.065669 Sep 25 01:07:28.580900 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 336/688] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:28 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e/os-volume_attachments => generated 25 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:07:28.655296 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:28.655822 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:28.658122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:28.664415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.665041 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.665550 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.666342 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.667096 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.667689 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.699828 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:28.799030 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d796097b-1864-424a-b6ef-ec6362ef3b64 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 204 len: 0 microversion: 2.1 time: 0.147464 Sep 25 01:07:28.799644 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 353/689] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:28 2022] DELETE /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:07:28.811160 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:28.811812 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:28.818901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.819765 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.820648 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.821490 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:28.821960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:28.822394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:28.845978 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:29.010221 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:29.021777 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-54979391-0840-4fde-879f-c9c516f08ef8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1681 microversion: 2.1 time: 0.214042 Sep 25 01:07:29.022948 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 337/690] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:28 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1681 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:29.084015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:29.084715 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:29.091560 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.092065 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.092549 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.093294 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.093769 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.094203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.119750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:29.120880 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:29.133432 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.133870 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.134304 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.135513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.136292 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.137057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.244825 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'services' on Instance uuid 96a47796-f432-4684-b4da-a8f0fbf960ec {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:29.314036 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:29.323539 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d11f8e11-1c1d-4ea9-9d50-214262be826b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.211505 Sep 25 01:07:29.324280 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 338/691] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:29 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:29.360479 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-fcb5fd8f-7770-4775-bfc7-5b28417b5b3d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments/a3f2210d-c752-4d44-b57a-ae5c02fa40f1" status: 202 len: 0 microversion: 2.1 time: 0.281587 Sep 25 01:07:29.361117 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 354/692] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:07:29 2022] DELETE /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments/a3f2210d-c752-4d44-b57a-ae5c02fa40f1 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:07:29.370932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:29.374080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:29.386168 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.386795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.387326 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.388186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.388807 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.389453 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.425590 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-36a0efc7-3dce-4535-960f-e8d8ae8672d2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058422 Sep 25 01:07:29.426351 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 339/693] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:29 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:29.462413 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:29.462413 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:29.469796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.470337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.470811 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.472639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.472639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.472941 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.503882 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:29.592007 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-79d4ea86-5980-4e09-8986-97ed2bf213e6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "DELETE /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 204 len: 0 microversion: 2.1 time: 0.134938 Sep 25 01:07:29.592653 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 355/694] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:29 2022] DELETE /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:07:29.603697 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:29.604923 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:29.614494 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.615035 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.615537 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.616850 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:29.617661 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:29.618406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:29.781553 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:29.795032 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d20319d7-478f-4426-8eb4-a5ce9cea6ec5 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1674 microversion: 2.1 time: 0.197676 Sep 25 01:07:29.795639 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 340/695] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:29 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1674 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:30.061500 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:30.062227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:30.069307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.069813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.070256 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.070985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.071447 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.071878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.233297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:30.242480 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-785eded4-31b2-4c36-a192-2d44304ae6a0 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1681 microversion: 2.1 time: 0.185312 Sep 25 01:07:30.243089 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 356/696] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:30 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1681 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:30.352142 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:30.352905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:30.360757 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.361314 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.361726 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.362460 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.362925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.363394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.443912 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:30.448047 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:30.457857 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.458829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.459306 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.460371 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.460980 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.461421 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.508938 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ac9890d9-7105-4e45-9ed6-e5b8267685c8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.071872 Sep 25 01:07:30.509829 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 357/697] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:30 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 197 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:30.544792 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:30.558097 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-48792e9d-6131-4b4f-9474-d41a08ccfe96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.210818 Sep 25 01:07:30.559357 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 341/698] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:30 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:30.819644 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:30.820309 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:30.826834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.827323 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.827800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.828587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:30.829091 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:30.829541 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:30.989837 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:30.999560 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d266c413-eff3-4435-aab2-c07babdd8993 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1674 microversion: 2.1 time: 0.183876 Sep 25 01:07:31.000171 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 358/699] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:30 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:31.268035 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:31.268693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:31.275745 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.276228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.276691 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.277412 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.277886 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.278579 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.446824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:31.457322 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a964f51f-b730-4620-8f40-ec035409f58b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1681 microversion: 2.1 time: 0.193305 Sep 25 01:07:31.458380 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 342/700] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:31 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1681 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:31.524939 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:31.527136 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:31.534855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.535510 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.535794 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.536622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.537589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.538024 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.574481 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-82ac3fa4-90f4-4f56-b504-637d247f8024 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055007 Sep 25 01:07:31.575259 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 359/701] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:31 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:31.600011 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:31.600955 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:31.607839 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.608343 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.608821 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.609796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:31.610414 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:31.611344 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:31.776241 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:31.791918 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5330cedf-910d-4416-8174-43b315f644f7 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.195976 Sep 25 01:07:31.793050 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 343/702] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:31 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:32.040077 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:32.041117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:32.049151 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.049782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.050375 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.051512 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.052696 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.053249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.209490 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:32.218180 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2429b80b-b6ab-4cef-a585-c193d2f1963b tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1674 microversion: 2.1 time: 0.183469 Sep 25 01:07:32.218882 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 360/703] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:32 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1674 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:32.486400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:32.487408 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:32.498864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.499648 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.500356 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.501581 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.502330 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.503024 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.595364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:32.599327 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:32.610341 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.611273 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.612192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.613292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.614122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.614832 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.658280 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1d598c2a-cfaf-4870-9856-23c29183750b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.072049 Sep 25 01:07:32.667515 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 361/704] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:32 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 197 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:32.728562 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:32.737726 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0c856cd4-7faa-4654-a3e1-0ee5649a1015 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1681 microversion: 2.1 time: 0.257555 Sep 25 01:07:32.738352 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 344/705] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:32 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:32.829229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:32.829864 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:32.836993 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.837497 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.837947 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:32.838681 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:32.839139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:32.839565 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.005408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:33.014635 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-905c2f81-7af7-4ac0-aaca-b71185985753 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.189434 Sep 25 01:07:33.015240 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 362/706] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:32 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:33.242747 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:33.243305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:33.250910 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.251576 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.252140 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.253120 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.253693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.254228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.418761 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:33.427895 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-579f6580-1e29-4b31-9d68-4e461c61fb18 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1674 microversion: 2.1 time: 0.189546 Sep 25 01:07:33.428601 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 345/707] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:33 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1674 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:33.675073 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:33.677628 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:33.684860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.685344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.685794 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.686523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.686986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.687422 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.721023 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-cae93a13-9f2d-495a-b61c-d683026cb800 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049872 Sep 25 01:07:33.721624 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 363/708] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:33 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:33.761863 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:33.762599 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:33.769726 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.770762 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.771218 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:33.771937 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:33.772419 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:33.772849 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.050421 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:34.052782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:34.068122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.069359 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.070514 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.071514 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:34.073694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.074713 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.075623 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.088459 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-493e031b-0087-4800-ae74-48d148275363 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1681 microversion: 2.1 time: 0.330235 Sep 25 01:07:34.105864 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 346/709] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:33 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1681 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:34.115458 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-184bbded-3dee-4777-aff6-3d410d28d87c req-8ad677d4-50e6-41e4-8105-f78d1c424316 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bda589-bfa8-4622-82e5-e6abb0298a27", "name": "network-vif-plugged", "status": "completed", "tag": "97378db9-6dd7-40b9-aa76-d8f70e6836fa"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:34.128880 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-184bbded-3dee-4777-aff6-3d410d28d87c req-8ad677d4-50e6-41e4-8105-f78d1c424316 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.129343 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-184bbded-3dee-4777-aff6-3d410d28d87c req-8ad677d4-50e6-41e4-8105-f78d1c424316 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.130403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-184bbded-3dee-4777-aff6-3d410d28d87c req-8ad677d4-50e6-41e4-8105-f78d1c424316 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.144794 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-184bbded-3dee-4777-aff6-3d410d28d87c req-8ad677d4-50e6-41e4-8105-f78d1c424316 service nova] Creating event network-vif-plugged:97378db9-6dd7-40b9-aa76-d8f70e6836fa for instance 24bda589-bfa8-4622-82e5-e6abb0298a27 on hv-cinder-maste Sep 25 01:07:34.150648 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-184bbded-3dee-4777-aff6-3d410d28d87c req-8ad677d4-50e6-41e4-8105-f78d1c424316 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042373 Sep 25 01:07:34.151294 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 347/710] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:34.331525 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:34.345178 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-96ded7aa-eb8a-4e3e-85f3-93902e54a42c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.304623 Sep 25 01:07:34.346219 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 364/711] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:34 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:34.454263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:34.455145 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:34.463333 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.463831 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.464270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.465025 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.465483 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.465905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.645762 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:34.657561 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a4ef3791-4155-438b-8be3-b602c40c26af tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1674 microversion: 2.1 time: 0.207989 Sep 25 01:07:34.658554 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 348/712] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:34 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1674 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:34.737787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:34.740279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:34.747426 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.747931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.748370 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.749145 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:34.749609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:34.750043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:34.754469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:34.798136 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7123252b-aa96-4c3e-a586-f8aba7d1f6c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.065138 Sep 25 01:07:34.799212 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 365/713] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:34 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:35.132564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:35.133969 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:35.150440 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.151521 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.152471 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.155035 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.157484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.160938 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.384446 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:35.385571 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:35.392773 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.393752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.395924 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.397157 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.397929 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.398839 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.656850 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:35.673753 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-81b6f4ea-2e0f-4ac8-a6cb-5a2f064ba244 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1681 microversion: 2.1 time: 0.552357 Sep 25 01:07:35.674443 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:35.687946 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 349/714] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:35 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1681 bytes in 556 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:35.695385 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-d4253fe1-1c23-4ed1-ac10-460baef2340b req-2752c739-484e-4cd4-9db7-b7c9f93c7220 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "731a9677-0b93-4792-819c-b75b56c0f5b1", "name": "network-vif-deleted", "tag": "25ea87eb-7543-4aed-9085-17cbcf974eb9"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:35.700625 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c2ddc569-0094-4987-b8d1-591ef286fb3e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.319990 Sep 25 01:07:35.702744 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 366/715] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:35 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:35.708504 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:35.709052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:35.715396 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d4253fe1-1c23-4ed1-ac10-460baef2340b req-2752c739-484e-4cd4-9db7-b7c9f93c7220 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.715396 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d4253fe1-1c23-4ed1-ac10-460baef2340b req-2752c739-484e-4cd4-9db7-b7c9f93c7220 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.715748 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d4253fe1-1c23-4ed1-ac10-460baef2340b req-2752c739-484e-4cd4-9db7-b7c9f93c7220 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.721564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.722058 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.722459 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.723252 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.723723 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.724252 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.730152 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-d4253fe1-1c23-4ed1-ac10-460baef2340b req-2752c739-484e-4cd4-9db7-b7c9f93c7220 service nova] Creating event network-vif-deleted:25ea87eb-7543-4aed-9085-17cbcf974eb9 for instance 731a9677-0b93-4792-819c-b75b56c0f5b1 on hv-cinder-maste Sep 25 01:07:35.735794 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-d4253fe1-1c23-4ed1-ac10-460baef2340b req-2752c739-484e-4cd4-9db7-b7c9f93c7220 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046028 Sep 25 01:07:35.736781 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 350/716] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:35.818437 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:35.821802 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:35.827021 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:35.829777 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.830546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.831052 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.831839 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:35.832358 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:35.833605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:35.840472 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-24d75162-c128-4644-a0b2-d599061ccc1f tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1514 microversion: 2.1 time: 0.136038 Sep 25 01:07:35.841883 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 367/717] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:35 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1514 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:35.884517 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9dbd6494-6318-47bf-b513-b2b5989792af tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.072174 Sep 25 01:07:35.886291 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 351/718] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:07:35 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec/os-volume_attachments => generated 25 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:07:36.078502 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:36.079944 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:36.096338 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.097996 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.099284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.101052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.102365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.103584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.163579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:36.300158 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8be09a06-7e13-44d5-a328-60201bab0a79 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 204 len: 0 microversion: 2.1 time: 0.228824 Sep 25 01:07:36.301445 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 368/719] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:36 2022] DELETE /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 0 bytes in 232 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:07:36.311400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:36.312901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:36.321258 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.321752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.322278 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.322982 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.323439 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.323861 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.932720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:36.933637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:36.940501 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.941017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.941494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:36.942295 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:36.943023 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:36.943467 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.002706 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:37.015024 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ed562a3c-ad6f-4a6b-bf7c-f0e96742b17f tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1686 microversion: 2.1 time: 0.707419 Sep 25 01:07:37.016211 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 352/720] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:36 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1686 bytes in 709 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:37.022501 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:37.023673 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:37.031932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.032477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.033498 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.037901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.038139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:37.040012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.042240 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.049810 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-aba27597-9223-4b4a-87da-3bf2ea74853e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1614 microversion: 2.1 time: 0.354081 Sep 25 01:07:37.055037 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 369/721] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:36 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1614 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:37.065244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:37.067424 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:37.078835 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.079850 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.081133 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.082630 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.083721 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.084431 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.141483 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.142244 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.143001 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.143608 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lazy-loading 'fault' on Instance uuid 731a9677-0b93-4792-819c-b75b56c0f5b1 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:37.214261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:37.230092 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ba609c61-f804-470b-97b5-9ad40a3273fe tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1349 microversion: 2.1 time: 0.172483 Sep 25 01:07:37.231066 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 370/722] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:37 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1349 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:37.242061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-60919786-88c3-4790-bbff-9bac78307d29 req-925a5864-a892-4de2-8d53-080ca329a7c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7d9d047b-1796-4f02-96c1-94e475e3b55e", "name": "network-vif-deleted", "tag": "b1424cc3-3df2-4c19-aeff-7dd43651ddad"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:37.255125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:37.263400 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-60919786-88c3-4790-bbff-9bac78307d29 req-925a5864-a892-4de2-8d53-080ca329a7c2 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:37.264274 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-60919786-88c3-4790-bbff-9bac78307d29 req-925a5864-a892-4de2-8d53-080ca329a7c2 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:37.265079 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-60919786-88c3-4790-bbff-9bac78307d29 req-925a5864-a892-4de2-8d53-080ca329a7c2 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:37.266502 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ddc41425-b7ba-4103-993b-25f8912299ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.248874 Sep 25 01:07:37.267189 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 353/723] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:37 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:37.286252 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-60919786-88c3-4790-bbff-9bac78307d29 req-925a5864-a892-4de2-8d53-080ca329a7c2 service nova] Creating event network-vif-deleted:b1424cc3-3df2-4c19-aeff-7dd43651ddad for instance 7d9d047b-1796-4f02-96c1-94e475e3b55e on hv-cinder-maste Sep 25 01:07:37.294787 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-60919786-88c3-4790-bbff-9bac78307d29 req-925a5864-a892-4de2-8d53-080ca329a7c2 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.060936 Sep 25 01:07:37.295776 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 371/724] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:38.048735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:38.049850 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:38.063011 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.063914 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.064767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.066071 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.066894 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.067657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.080170 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:38.081468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:38.094268 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.095114 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.095877 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.096912 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.097493 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.098394 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.204779 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:38.216532 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d0c41e38-cd6f-4279-b5ff-7542b150e3bf tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1614 microversion: 2.1 time: 0.142938 Sep 25 01:07:38.217387 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 372/725] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:38 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1614 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:38.261851 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:38.274180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:38.274994 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-72ce98bb-a4a7-4de9-9291-6cf924d9ae41 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1686 microversion: 2.1 time: 0.234255 Sep 25 01:07:38.275580 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:38.288824 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 354/726] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:38 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1686 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:38.289100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.289100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.289100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.289100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.289653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.289653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.312253 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:38.315607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:38.328692 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.329852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.330659 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.332007 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.332951 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:38.333526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.333700 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:38.333978 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.334381 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:38.334663 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lazy-loading 'fault' on Instance uuid 731a9677-0b93-4792-819c-b75b56c0f5b1 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:38.365529 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:38.413007 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:38.425631 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5e6f7031-93ce-4326-b006-d48fdcf2e6a6 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1349 microversion: 2.1 time: 0.157101 Sep 25 01:07:38.426302 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 373/727] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:38 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1349 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:38.513509 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:38.528434 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4fb7cf9b-74e2-46d6-a678-67ad9c2fee44 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.226411 Sep 25 01:07:38.529488 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 355/728] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:38 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:39.258789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:39.259416 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:39.266655 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.267203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.267724 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.268518 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.268988 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.269473 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.318600 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:39.319455 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:39.326776 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.327274 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.327717 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.328465 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.328921 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.329376 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.346189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.358158 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-874946ed-f9c7-4e6a-a752-abbf504d39ee tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1614 microversion: 2.1 time: 0.104526 Sep 25 01:07:39.359304 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 374/729] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:39 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1614 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:39.449888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:39.450513 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:39.457657 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.458154 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.458595 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.459313 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.459769 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.460188 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.502250 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.502740 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.503226 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.503682 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lazy-loading 'fault' on Instance uuid 731a9677-0b93-4792-819c-b75b56c0f5b1 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:39.547223 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.557192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.563889 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c546543c-0d0d-49ca-89c7-2615f98fbe2c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1686 microversion: 2.1 time: 0.250744 Sep 25 01:07:39.565094 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 356/730] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:39 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1686 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:39.567165 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1d235f81-1d90-42e4-bff4-5743b31c12f3 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1349 microversion: 2.1 time: 0.121032 Sep 25 01:07:39.568435 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 375/731] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:39 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1349 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:39.576808 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:39.578191 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:39.587407 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.588108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.588933 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.589788 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:39.590358 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:39.590913 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:39.741696 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:39.750571 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ea586c19-746f-45dd-b73e-8411e06b83b4 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1362 microversion: 2.1 time: 0.183808 Sep 25 01:07:39.751402 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 357/732] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:39 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1362 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:40.393425 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:40.394107 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:40.401599 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.402417 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.402867 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.403593 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.404063 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.404537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.482035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:40.494041 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-bee781d7-cbcf-4823-b0b3-b9d970811c18 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1326 microversion: 2.1 time: 0.104770 Sep 25 01:07:40.494683 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 376/733] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:40 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1326 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:40.589755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:40.590479 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:40.597706 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:40.599126 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.599283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:40.599715 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.600591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.601419 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.601932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.602385 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.604639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=3 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:40.610853 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.611615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.612731 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.613878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.614241 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.614797 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.651689 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.652093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.652583 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.653070 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lazy-loading 'fault' on Instance uuid 731a9677-0b93-4792-819c-b75b56c0f5b1 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:40.717014 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1bc4010eab744cf78053adb904f85dc5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a49eb5e19c0e44b3b9273f5126c0915f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:40.726586 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1d381c14-912a-4314-9fef-347468267606 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 200 len: 1349 microversion: 2.1 time: 0.133876 Sep 25 01:07:40.727513 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 377/734] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:40 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 1349 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:40.784185 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:40.787483 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:40.788841 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:40.796263 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7315bc64-6ebc-4783-ae3d-0544a54a3fe1 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1686 microversion: 2.1 time: 0.210521 Sep 25 01:07:40.797368 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 358/735] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:40 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1686 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:40.807036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.808123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.808969 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.810321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:40.811186 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:40.812417 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:40.970229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:40.979411 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e577c7fb-c49b-43be-b993-209aa36c051d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1548 microversion: 2.1 time: 0.200220 Sep 25 01:07:40.980197 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 378/736] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:40 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1548 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:41.011970 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:41.012667 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:41.019883 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.020163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.020466 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.021140 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.021606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.022030 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.191235 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6ae83077-3389-4c12-85ff-a59eb27c0f84 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183138 Sep 25 01:07:41.192301 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 359/737] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:07:41 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-interface => generated 285 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:41.523167 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:41.531836 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:41.544745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.545910 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.546994 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.548486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.549625 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.550480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.590878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:41.637117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.638249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.639308 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.640348 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lazy-loading 'fault' on Instance uuid 7d9d047b-1796-4f02-96c1-94e475e3b55e {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:41.722576 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:41.738274 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-66e6089e-97a9-4122-b976-7bfdf920254f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 200 len: 1331 microversion: 2.1 time: 0.222149 Sep 25 01:07:41.739834 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 379/738] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:41 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 1331 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:41.779826 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:41.780752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] [instance: 731a9677-0b93-4792-819c-b75b56c0f5b1] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:41.787804 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.788692 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.789291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.790340 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.796810 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.803026 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.822029 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] HTTP exception thrown: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 could not be found. Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Request method failure captured: Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 HTTP/1.1 Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6i7zT_134PvVSsgwvf5AU4iTDCV7wD9BuILjlM9e30_bqPiziFIaGIMlL72PVpT--eF8QOCnd5_mTrlgcbsPDXBZP7tc-sBN8VjYRdtqXVZbHLoH5wiOsCENdpgD7O4-Uavq-bmpSHVPx3DaeblarhkqspH4Er9M4lclbG0cdBKbSM Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: a49eb5e19c0e44b3b9273f5126c0915f Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-TestMinimumBasicScenario-574361902 Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:07:41.825533 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_a49eb5e19c0e44b3b9273f5126c0915f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/a49eb5e19c0e44b3b9273f5126c0915f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a49eb5e19c0e44b3b9273f5126c0915f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/a49eb5e19c0e44b3b9273f5126c0915f"}]}] Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-TestMinimumBasicScenario-574361902 Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: a49eb5e19c0e44b3b9273f5126c0915f Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestMinimumBasicScenario-574361902 Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-TestMinimumBasicScenario-574361902-project Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 1bc4010eab744cf78053adb904f85dc5 Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-TestMinimumBasicScenario-574361902-project Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 could not be found. Sep 25 01:07:41.827017 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '731a9677-0b93-4792-819c-b75b56c0f5b1'} Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 could not be found. Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:41.828256 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 could not be found. Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 could not be found. Sep 25 01:07:41.830284 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:41.834312 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Returning 404 to user: Instance 731a9677-0b93-4792-819c-b75b56c0f5b1 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:41.835507 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-baf7f5fb-2415-44b6-9b2d-9b6fb1997a5e tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1" status: 404 len: 111 microversion: 2.1 time: 0.076238 Sep 25 01:07:41.836566 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 360/739] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:41 2022] GET /compute/v2.1/servers/731a9677-0b93-4792-819c-b75b56c0f5b1 => generated 111 bytes in 78 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:41.836751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:41.837450 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:41.847865 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.848942 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.849163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b67dfb7a-88a4-4216-87b1-1bf652daabe7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] Calling method '.version_select at 0x7f118136ddc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:41.849500 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.851034 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:41.855130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:41.855787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:41.879966 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b67dfb7a-88a4-4216-87b1-1bf652daabe7 tempest-TestMinimumBasicScenario-574361902 tempest-TestMinimumBasicScenario-574361902-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1204173063" status: 202 len: 0 microversion: 2.1 time: 0.034551 Sep 25 01:07:41.881530 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 361/740] 10.222.0.26 () {58 vars in 1272 bytes} [Sun Sep 25 01:07:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1204173063 => generated 0 bytes in 37 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:07:42.055713 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:42.072699 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6a47d0e0-e515-4339-83e0-a13be164ce1d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1686 microversion: 2.1 time: 0.249838 Sep 25 01:07:42.074436 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 380/741] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:41 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1686 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:42.781180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:42.782335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:42.797220 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.798295 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.800280 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.801975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:42.802545 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:42.803119 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:42.820799 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e HTTP/1.1 Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:07:42.822472 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:07:42.825869 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '7d9d047b-1796-4f02-96c1-94e475e3b55e'} Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:42.833778 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:07:42.836665 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:42.839809 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:42.839809 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-37846a5d-47b2-4ca2-b9dc-0f485b6b67e7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 404 len: 111 microversion: 2.1 time: 0.051219 Sep 25 01:07:42.839809 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 362/742] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:42 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:07:42.841491 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a8d3dcf6-7e34-4b45-99ea-d11575769c65 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '.version_select at 0x7f11813f2d30>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:42.870506 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a8d3dcf6-7e34-4b45-99ea-d11575769c65 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-524404470" status: 202 len: 0 microversion: 2.1 time: 0.036596 Sep 25 01:07:42.877871 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 381/743] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Sep 25 01:07:42 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-524404470 => generated 0 bytes in 41 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:07:43.102578 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:43.103752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:43.130004 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:43.131362 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:43.132530 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:43.133887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:43.134612 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:43.141728 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:43.237381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-fe59ffd6-6926-4d4d-a9cd-89d8f0c8c19c req-67bb37ce-664c-40a4-ab5d-7616e7d4741f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96a47796-f432-4684-b4da-a8f0fbf960ec", "name": "network-vif-deleted", "tag": "8bf7effb-12ff-4f20-9f6a-7e7a86645f20"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:43.273127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-fe59ffd6-6926-4d4d-a9cd-89d8f0c8c19c req-67bb37ce-664c-40a4-ab5d-7616e7d4741f service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:43.274222 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-fe59ffd6-6926-4d4d-a9cd-89d8f0c8c19c req-67bb37ce-664c-40a4-ab5d-7616e7d4741f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:43.274721 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-fe59ffd6-6926-4d4d-a9cd-89d8f0c8c19c req-67bb37ce-664c-40a4-ab5d-7616e7d4741f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:43.302969 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-fe59ffd6-6926-4d4d-a9cd-89d8f0c8c19c req-67bb37ce-664c-40a4-ab5d-7616e7d4741f service nova] Creating event network-vif-deleted:8bf7effb-12ff-4f20-9f6a-7e7a86645f20 for instance 96a47796-f432-4684-b4da-a8f0fbf960ec on hv-cinder-maste Sep 25 01:07:43.309319 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-fe59ffd6-6926-4d4d-a9cd-89d8f0c8c19c req-67bb37ce-664c-40a4-ab5d-7616e7d4741f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082356 Sep 25 01:07:43.310600 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 382/744] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:43.313662 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:43.326242 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e9687e41-197f-4608-86e7-924cdd722396 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 200 len: 1619 microversion: 2.1 time: 0.230369 Sep 25 01:07:43.332562 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 363/745] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:43 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 1619 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:44.357863 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:44.358717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 96a47796-f432-4684-b4da-a8f0fbf960ec] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:44.375556 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:44.377018 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:44.378042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:44.380298 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:44.381287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:44.382075 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:44.422028 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] HTTP exception thrown: Instance 96a47796-f432-4684-b4da-a8f0fbf960ec could not be found. Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Request method failure captured: Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec HTTP/1.1 Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hKYF4_JwUcbTnW4oRzcy7qEP1dfTBC03wPczp6YeO0UWOgoDHfENsdVRYOxxBcqqOO0s8JXTrZhsw4D9VYMLmNQ7prt1YpRIiMWnbMRoU0pYX2RRAKjC6oQTg0-iMuzBG-yzx2btCP21DnX3Vo36OLBB_Ok4iLN8V_gchQjZhG2kc Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:07:44.425201 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5b11c2ffde89471cafaf35f8579e3ab2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}] Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: ca20e105b76149dd99e4aa64c62eb483 Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 96a47796-f432-4684-b4da-a8f0fbf960ec could not be found. Sep 25 01:07:44.427544 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '96a47796-f432-4684-b4da-a8f0fbf960ec'} Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96a47796-f432-4684-b4da-a8f0fbf960ec could not be found. Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:44.428319 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96a47796-f432-4684-b4da-a8f0fbf960ec could not be found. Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96a47796-f432-4684-b4da-a8f0fbf960ec could not be found. Sep 25 01:07:44.435338 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:07:44.437964 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Returning 404 to user: Instance 96a47796-f432-4684-b4da-a8f0fbf960ec could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:44.437964 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-887297f2-1918-42d5-9b43-976fef197fe8 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec" status: 404 len: 111 microversion: 2.1 time: 0.076361 Sep 25 01:07:44.437964 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 383/746] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:44 2022] GET /compute/v2.1/servers/96a47796-f432-4684-b4da-a8f0fbf960ec => generated 111 bytes in 79 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:07:44.440062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dc6b60a5-a751-44cf-8c18-620c1450376d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '.version_select at 0x7f11811ff9d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:44.474492 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dc6b60a5-a751-44cf-8c18-620c1450376d tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077848609" status: 202 len: 0 microversion: 2.1 time: 0.038940 Sep 25 01:07:44.476026 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 364/747] 10.222.0.26 () {58 vars in 1221 bytes} [Sun Sep 25 01:07:44 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2077848609 => generated 0 bytes in 42 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:07:45.353829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-d593ff60-e43d-45ba-875c-e31f79a5a118 req-c85b55a3-9c98-43b7-b7a9-d99c63105334 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "24bda589-bfa8-4622-82e5-e6abb0298a27", "tag": "97378db9-6dd7-40b9-aa76-d8f70e6836fa"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:45.365012 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d593ff60-e43d-45ba-875c-e31f79a5a118 req-c85b55a3-9c98-43b7-b7a9-d99c63105334 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:45.365671 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d593ff60-e43d-45ba-875c-e31f79a5a118 req-c85b55a3-9c98-43b7-b7a9-d99c63105334 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:45.366057 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-d593ff60-e43d-45ba-875c-e31f79a5a118 req-c85b55a3-9c98-43b7-b7a9-d99c63105334 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:45.405059 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-d593ff60-e43d-45ba-875c-e31f79a5a118 req-c85b55a3-9c98-43b7-b7a9-d99c63105334 service nova] Creating event network-changed:97378db9-6dd7-40b9-aa76-d8f70e6836fa for instance 24bda589-bfa8-4622-82e5-e6abb0298a27 on hv-cinder-maste Sep 25 01:07:45.409640 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0f998211-5b20-4643-ab0c-1fc60f0eb7d1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: .version_select at 0x7f1181226700>, body: {"keypair": {"name": "tempest-keypair-965351424", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIcwMujMh7RdYI46u9QFi78phIdpEYHf4PGStZYg8HWM+PPF+TnD5QZ3apn7IFCyCn1GkaCx/o13q/qH/RmF1+tllvPOFKSmtGmOCK6CFSQNeVa7jhcFXhmBkEwSce8ELw=="}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:45.416159 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-d593ff60-e43d-45ba-875c-e31f79a5a118 req-c85b55a3-9c98-43b7-b7a9-d99c63105334 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.067729 Sep 25 01:07:45.418137 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 384/748] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:45.431940 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=95,nova_api:DELETE=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:45.444029 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-0f998211-5b20-4643-ab0c-1fc60f0eb7d1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:07:45.465785 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-0f998211-5b20-4643-ab0c-1fc60f0eb7d1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:07:45.525833 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0f998211-5b20-4643-ab0c-1fc60f0eb7d1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.120722 Sep 25 01:07:45.527968 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 365/749] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:07:45 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:48.559874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1251003116", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b"}], "security_groups": [{"name": "tempest-securitygroup--614685858"}], "key_name": "tempest-keypair-965351424", "user_data": "}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:48.732974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] validate_networks() for [('3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:07:48.733197 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:48.733834 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:48.745465 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:48.746196 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:48.746648 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:48.747387 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:48.747847 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:48.748320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:48.777996 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:48.876254 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dfcd0c2f-0940-46f0-b2b1-393af8733bce tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "DELETE /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 204 len: 0 microversion: 2.1 time: 0.147840 Sep 25 01:07:48.880359 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 366/750] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:48 2022] DELETE /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:48.895472 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:48.896477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:48.905089 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:48.905872 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:48.906328 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:48.907068 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:48.908652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:48.909240 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:49.215186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:49.229976 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4f28082b-c5b5-46ab-993e-a9a2a59cc33e tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1508 microversion: 2.1 time: 0.347414 Sep 25 01:07:49.251719 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 367/751] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:48 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1508 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:49.478430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:07:49.478864 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:07:49.479380 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:07:49.481017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:07:49.483356 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:07:49.506797 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:49.507829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:49.508732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:49.510474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:49.511304 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:49.512045 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:49.551916 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:07:49.562642 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:07:49.591008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:07:49.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:07:49.723086 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-247b87ac-eff5-4757-860b-305174a639e6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.168454 Sep 25 01:07:49.728118 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 385/752] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:07:48 2022] POST /compute/v2.1/servers => generated 401 bytes in 1175 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:07:49.740023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-acf46ad5-2f51-42e0-9a9f-d83fe21cfd7e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:49.741439 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-acf46ad5-2f51-42e0-9a9f-d83fe21cfd7e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:49.864614 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-acf46ad5-2f51-42e0-9a9f-d83fe21cfd7e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:49.880345 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-acf46ad5-2f51-42e0-9a9f-d83fe21cfd7e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1241 microversion: 2.1 time: 0.140756 Sep 25 01:07:49.881883 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 368/753] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:49 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1241 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:50.273949 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:50.275174 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:50.285042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:50.285989 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:50.286602 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:50.287780 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:50.288470 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:50.289209 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:50.522884 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:50.544001 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3abfa138-d3fb-4205-ae78-cf7b46386cdf tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1508 microversion: 2.1 time: 0.277249 Sep 25 01:07:50.562449 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 386/754] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:50 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1508 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:50.704648 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-58d06577-e1df-4935-89c3-bca3de227736 req-fd0c13c4-b32e-4e0c-8ee7-7913ba741d1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837", "name": "network-vif-deleted", "tag": "9739bed4-bbec-4ba0-bac9-b44811070189"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:50.729025 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-58d06577-e1df-4935-89c3-bca3de227736 req-fd0c13c4-b32e-4e0c-8ee7-7913ba741d1c service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:50.730019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-58d06577-e1df-4935-89c3-bca3de227736 req-fd0c13c4-b32e-4e0c-8ee7-7913ba741d1c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:50.731792 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-58d06577-e1df-4935-89c3-bca3de227736 req-fd0c13c4-b32e-4e0c-8ee7-7913ba741d1c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:50.754389 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-58d06577-e1df-4935-89c3-bca3de227736 req-fd0c13c4-b32e-4e0c-8ee7-7913ba741d1c service nova] Creating event network-vif-deleted:9739bed4-bbec-4ba0-bac9-b44811070189 for instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 on hv-cinder-maste Sep 25 01:07:50.764120 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-58d06577-e1df-4935-89c3-bca3de227736 req-fd0c13c4-b32e-4e0c-8ee7-7913ba741d1c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066895 Sep 25 01:07:50.765837 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 369/755] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:07:50.910790 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:50.912139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:50.920925 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:50.922066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:50.922820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:50.923801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:50.925134 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:50.925924 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.063400 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:51.081189 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b12f2541-f454-4cc2-acef-07daea0f62f4 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1293 microversion: 2.1 time: 0.177403 Sep 25 01:07:51.089260 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 387/756] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:50 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1293 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:51.577070 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:51.577924 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:51.587513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:51.588359 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:51.589227 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.590401 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:51.591236 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:51.591972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.678555 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:51.681558 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:51.684678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:51.686154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'fault' on Instance uuid 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:51.790291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:51.821301 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bbda296e-b4ed-4172-8867-67b7724005e2 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 200 len: 1311 microversion: 2.1 time: 0.248404 Sep 25 01:07:51.823960 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 370/757] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:51 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 1311 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:52.122153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:52.123073 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:52.131292 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.131808 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.132259 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.133208 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.133532 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.133532 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.209398 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:52.217724 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a0b582fd-370c-460d-958c-d6b85248ff76 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1299 microversion: 2.1 time: 0.099470 Sep 25 01:07:52.218340 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 388/758] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:52 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1299 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:52.857108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:52.858270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:52.867388 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.867929 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.868701 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.869803 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.870530 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.871303 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.888059 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] HTTP exception thrown: Instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 could not be found. Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Request method failure captured: Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 HTTP/1.1 Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hKYF4_JwUcbTnW4oRzcy7qEP1dfTBC03wPczp6YeO0UWOgoDHfENsdVRYOxxBcqqOO0s8JXTrZhsw4D9VYMLmNQ7prt1YpRIiMWnbMRoU0pYX2RRAKjC6oQTg0-iMuzBG-yzx2btCP21DnX3Vo36OLBB_Ok4iLN8V_gchQjZhG2kc Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:07:52.889898 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5b11c2ffde89471cafaf35f8579e3ab2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}] Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: ca20e105b76149dd99e4aa64c62eb483 Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 could not be found. Sep 25 01:07:52.892900 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837'} Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 could not be found. Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:07:52.894614 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 could not be found. Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 could not be found. Sep 25 01:07:52.897640 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:07:52.901814 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Returning 404 to user: Instance 4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:07:52.901814 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d093a299-6f21-4e9f-ab52-eeab22299dc9 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837" status: 404 len: 111 microversion: 2.1 time: 0.038904 Sep 25 01:07:52.901814 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 371/759] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:52 2022] GET /compute/v2.1/servers/4b2bbd4a-ffc2-48f4-b6de-f8c407a6f837 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:07:52.906632 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:52.907330 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:52.919295 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.920214 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.921833 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.923960 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:52.924875 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:52.925704 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:52.977744 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:07:53.123132 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-94a63dec-1012-4df6-8194-afb0e0948851 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 204 len: 0 microversion: 2.1 time: 0.224761 Sep 25 01:07:53.124863 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 389/760] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:07:52 2022] DELETE /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:07:53.137552 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:53.138249 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:53.154659 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.155306 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.155836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.156693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.157426 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.157998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.248518 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:53.249873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:53.258308 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.259789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.260563 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.261545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:53.262261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:53.262913 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:53.368919 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:53.392571 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1d191b75-97e6-4e0c-85b4-42767ae2bb71 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1299 microversion: 2.1 time: 0.147397 Sep 25 01:07:53.393664 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 390/761] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:53 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1299 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:53.461205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:53.472017 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b0cabe7a-9d48-413f-9480-1f80a163f7ee tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.340579 Sep 25 01:07:53.493762 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 372/762] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:53 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:54.417843 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:54.420446 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:54.430819 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:54.431407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:54.431925 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:54.432780 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:54.433324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:54.433840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:54.501323 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:54.501963 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:54.515413 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:54.516023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:54.516508 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:54.517290 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:54.517713 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:54.518178 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:54.723900 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:54.747438 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0b9291ae-3d05-4042-a6c8-d8bf570b881b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.329433 Sep 25 01:07:54.748623 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 391/763] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:54 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:54.787218 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:54.806194 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d2a69fe8-389a-4f40-96d2-a748e643f38b tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.308708 Sep 25 01:07:54.807061 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 373/764] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:54 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:55.790826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:55.791561 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:55.803239 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:55.803991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:55.804467 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:55.805305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:55.805772 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:55.806210 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:55.832235 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:55.833537 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:55.841106 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:55.843490 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:55.843986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:55.844782 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:55.845253 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:55.845688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:56.149839 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:56.160918 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-662dd0ff-c7e9-46da-84c1-04b36253a1d6 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.374344 Sep 25 01:07:56.161957 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 392/765] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:55 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:56.448692 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:56.467245 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6ceec0d4-d714-4330-b38b-341fbe4011c7 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1521 microversion: 2.1 time: 0.638273 Sep 25 01:07:56.469238 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 374/766] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:55 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1521 bytes in 643 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:56.807807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-06095f60-10e7-4d5e-87fa-eac81c0ea77f req-1f6fc255-e0e9-4765-b3da-759f11dc0481 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6815476f-37aa-4fc5-a8d2-aee8955e5288", "tag": "a7a24556-e0e6-4b12-aa94-d3eae8c8733c"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:56.836733 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-06095f60-10e7-4d5e-87fa-eac81c0ea77f req-1f6fc255-e0e9-4765-b3da-759f11dc0481 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:56.837870 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-06095f60-10e7-4d5e-87fa-eac81c0ea77f req-1f6fc255-e0e9-4765-b3da-759f11dc0481 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:56.838532 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-06095f60-10e7-4d5e-87fa-eac81c0ea77f req-1f6fc255-e0e9-4765-b3da-759f11dc0481 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:56.858385 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-06095f60-10e7-4d5e-87fa-eac81c0ea77f req-1f6fc255-e0e9-4765-b3da-759f11dc0481 service nova] Creating event network-changed:a7a24556-e0e6-4b12-aa94-d3eae8c8733c for instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 on hv-cinder-maste Sep 25 01:07:56.867870 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-06095f60-10e7-4d5e-87fa-eac81c0ea77f req-1f6fc255-e0e9-4765-b3da-759f11dc0481 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071467 Sep 25 01:07:56.868964 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 393/767] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:57.198737 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:57.209090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:57.216570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:57.216797 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:57.217296 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:57.218195 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:57.218982 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:57.219455 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:57.491975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:57.506880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:57.509542 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:57.519870 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:57.520765 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:57.521473 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:57.522481 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:57.523172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:57.525860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:57.528419 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b03b58f6-ca44-4f42-a027-c99094c7859b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.335183 Sep 25 01:07:57.558271 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 375/768] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:57 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:07:57.580228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:57.580228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:57.580228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:57.580228 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'fault' on Instance uuid d51dd9a7-b187-4c50-a7e5-380a2f8356f6 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:57.680751 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:57.695591 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d850d8d6-9891-4300-8dc3-ee52e7a66ada tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1311 microversion: 2.1 time: 0.198428 Sep 25 01:07:57.696205 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 394/769] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:57 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1311 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:58.588551 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:58.589277 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:58.595935 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:58.596451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:58.597473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:58.598193 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:58.598680 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:58.599108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:58.754874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:58.755663 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:58.763374 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:58.763916 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:58.764364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:58.765266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:58.765800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:58.766240 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:58.805767 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:58.806500 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:58.806983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:58.807454 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'fault' on Instance uuid d51dd9a7-b187-4c50-a7e5-380a2f8356f6 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:07:58.817174 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:58.827857 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-827e7c6e-e534-4227-a807-ed5de8e2282b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.243497 Sep 25 01:07:58.828868 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 376/770] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:58 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:58.858932 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:07:58.872193 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e72620ad-27cd-444c-aa03-602af5383977 tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1311 microversion: 2.1 time: 0.121845 Sep 25 01:07:58.873490 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 395/771] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:58 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1311 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:07:58.896760 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-c5a46169-980d-4e69-b42e-606279187f87 req-054cc42a-5b39-41f0-b27c-d72acfb2928d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d51dd9a7-b187-4c50-a7e5-380a2f8356f6", "name": "network-vif-deleted", "tag": "056e7050-4827-4ef1-84e3-68f4134569a1"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:07:58.911609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c5a46169-980d-4e69-b42e-606279187f87 req-054cc42a-5b39-41f0-b27c-d72acfb2928d service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:58.912169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c5a46169-980d-4e69-b42e-606279187f87 req-054cc42a-5b39-41f0-b27c-d72acfb2928d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:58.912818 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c5a46169-980d-4e69-b42e-606279187f87 req-054cc42a-5b39-41f0-b27c-d72acfb2928d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:58.918658 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:58.930653 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-c5a46169-980d-4e69-b42e-606279187f87 req-054cc42a-5b39-41f0-b27c-d72acfb2928d service nova] Creating event network-vif-deleted:056e7050-4827-4ef1-84e3-68f4134569a1 for instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 on hv-cinder-maste Sep 25 01:07:58.937460 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-c5a46169-980d-4e69-b42e-606279187f87 req-054cc42a-5b39-41f0-b27c-d72acfb2928d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045536 Sep 25 01:07:58.938136 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 377/772] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:07:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:07:59.867430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:59.868104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:59.870568 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:59.871462 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=6 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:59.878537 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.879036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.879477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.880191 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.880667 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.881088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.911000 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:07:59.917162 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:07:59.918080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:07:59.927898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.928605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.929148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.929980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.930687 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.931517 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.980736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:07:59.981597 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:07:59.982397 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:07:59.983190 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lazy-loading 'fault' on Instance uuid d51dd9a7-b187-4c50-a7e5-380a2f8356f6 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:00.042521 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ca20e105b76149dd99e4aa64c62eb483', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5b11c2ffde89471cafaf35f8579e3ab2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:00.051493 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ea038e95-49f2-46eb-89d5-a5878368a17a tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 200 len: 1311 microversion: 2.1 time: 0.144755 Sep 25 01:08:00.052098 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 378/773] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:59 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 1311 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:00.070111 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:00.078503 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-810b41ea-f0fa-4676-8081-7bdc552c64a2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.215357 Sep 25 01:08:00.079104 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 396/774] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:07:59 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:01.075718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:01.076542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] [instance: d51dd9a7-b187-4c50-a7e5-380a2f8356f6] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:01.090765 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.091828 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.092999 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.094568 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.095421 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.096204 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.103891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:01.105094 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:01.113539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.114038 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.114480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.115208 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:01.115668 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:01.116102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:01.121268 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] HTTP exception thrown: Instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 could not be found. Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Request method failure captured: Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 HTTP/1.1 Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hKYF4_JwUcbTnW4oRzcy7qEP1dfTBC03wPczp6YeO0UWOgoDHfENsdVRYOxxBcqqOO0s8JXTrZhsw4D9VYMLmNQ7prt1YpRIiMWnbMRoU0pYX2RRAKjC6oQTg0-iMuzBG-yzx2btCP21DnX3Vo36OLBB_Ok4iLN8V_gchQjZhG2kc Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:08:01.123054 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_5b11c2ffde89471cafaf35f8579e3ab2", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/5b11c2ffde89471cafaf35f8579e3ab2"}]}] Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 5b11c2ffde89471cafaf35f8579e3ab2 Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2147449545 Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: ca20e105b76149dd99e4aa64c62eb483 Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2147449545-project Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 could not be found. Sep 25 01:08:01.125470 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'd51dd9a7-b187-4c50-a7e5-380a2f8356f6'} Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 could not be found. Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:01.126730 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 could not be found. Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 could not be found. Sep 25 01:08:01.129622 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:08:01.131747 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] Returning 404 to user: Instance d51dd9a7-b187-4c50-a7e5-380a2f8356f6 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:01.131747 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7c5842bc-0ae5-40d6-8388-62ab2739435c tempest-ServerRescueNegativeTestJSON-2147449545 tempest-ServerRescueNegativeTestJSON-2147449545-project] 10.222.0.26 "GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6" status: 404 len: 111 microversion: 2.1 time: 0.053093 Sep 25 01:08:01.131747 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 379/775] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:01 2022] GET /compute/v2.1/servers/d51dd9a7-b187-4c50-a7e5-380a2f8356f6 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:01.294192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:01.298102 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:01.305378 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9b0f1015-4927-4e17-a042-e060e76e4195 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.205538 Sep 25 01:08:01.306015 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 397/776] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:01 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:02.346606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:02.347678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:02.359910 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:02.361190 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:02.361571 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:02.363467 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:02.364311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:02.365126 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:02.598370 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:02.613063 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d15e0c9d-8027-42f6-8524-9dae733152e8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.271287 Sep 25 01:08:02.614704 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 380/777] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:02 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:03.642631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:03.644919 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:03.654659 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:03.655233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:03.655638 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.656652 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:03.657325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:03.657988 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:03.923229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:03.941257 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-95ce5203-8bc0-412d-8753-f235d4432259 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.304573 Sep 25 01:08:03.942535 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 398/778] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:03 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:04.203722 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-173e990d-2199-4873-837e-a2b169797e3b req-a92ba589-97ad-4967-b980-ec18b489de2f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6815476f-37aa-4fc5-a8d2-aee8955e5288", "name": "network-vif-plugged", "status": "completed", "tag": "a7a24556-e0e6-4b12-aa94-d3eae8c8733c"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:04.228093 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-173e990d-2199-4873-837e-a2b169797e3b req-a92ba589-97ad-4967-b980-ec18b489de2f service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.229284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-173e990d-2199-4873-837e-a2b169797e3b req-a92ba589-97ad-4967-b980-ec18b489de2f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.230073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-173e990d-2199-4873-837e-a2b169797e3b req-a92ba589-97ad-4967-b980-ec18b489de2f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.252240 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-173e990d-2199-4873-837e-a2b169797e3b req-a92ba589-97ad-4967-b980-ec18b489de2f service nova] Creating event network-vif-plugged:a7a24556-e0e6-4b12-aa94-d3eae8c8733c for instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 on hv-cinder-maste Sep 25 01:08:04.262096 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-173e990d-2199-4873-837e-a2b169797e3b req-a92ba589-97ad-4967-b980-ec18b489de2f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066574 Sep 25 01:08:04.263059 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 381/779] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:04.984800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:04.985586 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:04.994026 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.994620 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.995105 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:04.996018 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:04.996866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:04.997480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:05.279059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:05.299008 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-730ecc8c-c9c1-42b7-acd1-465d47a70ec3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1366 microversion: 2.1 time: 0.319875 Sep 25 01:08:05.301043 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 399/780] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:04 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1366 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:06.342786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.343656 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:06.351879 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.352522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.352933 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.353608 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.354072 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.354513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.573452 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:06.582862 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5e33c612-9434-4123-98ec-cd2959e1c2a7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1556 microversion: 2.1 time: 0.244431 Sep 25 01:08:06.583461 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 382/781] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1556 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:06.611148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:06.612644 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:06.623631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.624367 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.625196 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.626464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:06.627259 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:06.628017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:06.734835 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-97a773b0-77d3-4a43-b423-95b87b81f311 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.130711 Sep 25 01:08:06.736201 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 400/782] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:08:06 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-interface => generated 285 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:08:08.296899 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-e0dbf80c-54cc-4a1d-a063-229690fb79a5 req-fe8ef766-855f-4092-b58d-c9fec97db329 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6815476f-37aa-4fc5-a8d2-aee8955e5288", "tag": "a7a24556-e0e6-4b12-aa94-d3eae8c8733c"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:08.310365 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e0dbf80c-54cc-4a1d-a063-229690fb79a5 req-fe8ef766-855f-4092-b58d-c9fec97db329 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:08.310546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e0dbf80c-54cc-4a1d-a063-229690fb79a5 req-fe8ef766-855f-4092-b58d-c9fec97db329 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:08.311422 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-e0dbf80c-54cc-4a1d-a063-229690fb79a5 req-fe8ef766-855f-4092-b58d-c9fec97db329 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:08.328143 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-e0dbf80c-54cc-4a1d-a063-229690fb79a5 req-fe8ef766-855f-4092-b58d-c9fec97db329 service nova] Creating event network-changed:a7a24556-e0e6-4b12-aa94-d3eae8c8733c for instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 on hv-cinder-maste Sep 25 01:08:08.335462 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-e0dbf80c-54cc-4a1d-a063-229690fb79a5 req-fe8ef766-855f-4092-b58d-c9fec97db329 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042896 Sep 25 01:08:08.336658 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 383/783] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:18.747353 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=74,nova_api:DELETE=1,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:18.748110 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=16 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:18.965168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1629390800", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "networks": [{"uuid": "0a6e0e8f-f9b9-4302-bda4-8e67ea3c44af"}]}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:19.042531 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] validate_networks() for [('0a6e0e8f-f9b9-4302-bda4-8e67ea3c44af', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:08:19.561837 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:08:19.562451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:08:19.563334 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:08:19.564477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:08:19.565239 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:08:19.582035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:19.582903 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:19.583693 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:19.585111 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:19.585964 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:19.586744 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:19.626375 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Getting quotas for project 37c3708702654977b6b7bbb104255e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:08:19.634978 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Getting quotas for user d584320fc5044638914728ab9d050fc4 and project 37c3708702654977b6b7bbb104255e3f. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:08:19.658479 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:08:19.663188 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:08:19.762431 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-be44a537-3a99-4967-9376-118637ede3f7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.016092 Sep 25 01:08:19.763634 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 401/784] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:08:18 2022] POST /compute/v2.1/servers => generated 380 bytes in 1019 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:08:19.784765 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-00f0418d-d594-4251-87ae-2a1191592dc2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:19.785967 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-00f0418d-d594-4251-87ae-2a1191592dc2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:19.789411 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=54,nova_api:INSERT=1,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:19.791073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=26 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:19.876290 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-00f0418d-d594-4251-87ae-2a1191592dc2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:19.885391 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-00f0418d-d594-4251-87ae-2a1191592dc2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1214 microversion: 2.1 time: 0.105952 Sep 25 01:08:19.886018 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 384/785] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:19 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1214 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:20.930852 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:20.931921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:20.945510 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:20.946188 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:20.946660 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:20.947451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:20.947926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:20.948366 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:21.039925 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:21.051653 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-26732afd-15df-43b4-9629-0025a51e3b07 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1210 microversion: 2.1 time: 0.130125 Sep 25 01:08:21.052265 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 402/786] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:20 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1210 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:22.095568 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:22.097953 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:22.113251 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:22.114253 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:22.116173 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:22.116652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:22.117416 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:22.118224 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:22.590077 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:22.602316 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fbe7c572-d4b1-4ff4-8f9c-ae88d0eadc21 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1272 microversion: 2.1 time: 0.515564 Sep 25 01:08:22.603196 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 385/787] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:22 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1272 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:23.638600 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:23.639425 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:23.650140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:23.651062 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:23.651923 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:23.653346 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:23.654173 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:23.654639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:23.862464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:23.877976 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a56e6708-383f-47d0-b868-d552f2859005 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1314 microversion: 2.1 time: 0.246424 Sep 25 01:08:23.879052 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 403/788] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:23 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:24.362093 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-d81f9d30-717f-4d52-a2da-3e4dd63f9e3d req-f4aac76f-dfbc-4c17-a4b1-48653dff8ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dbd2fde1-018a-4f18-b324-4bf74c6747fd", "tag": "3c2cd66b-96d9-41ab-8400-a26fbb63f062"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:24.385229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d81f9d30-717f-4d52-a2da-3e4dd63f9e3d req-f4aac76f-dfbc-4c17-a4b1-48653dff8ab5 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:24.386857 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d81f9d30-717f-4d52-a2da-3e4dd63f9e3d req-f4aac76f-dfbc-4c17-a4b1-48653dff8ab5 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:24.387174 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d81f9d30-717f-4d52-a2da-3e4dd63f9e3d req-f4aac76f-dfbc-4c17-a4b1-48653dff8ab5 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:24.423584 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-d81f9d30-717f-4d52-a2da-3e4dd63f9e3d req-f4aac76f-dfbc-4c17-a4b1-48653dff8ab5 service nova] Creating event network-changed:3c2cd66b-96d9-41ab-8400-a26fbb63f062 for instance dbd2fde1-018a-4f18-b324-4bf74c6747fd on hv-cinder-maste Sep 25 01:08:24.433370 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-d81f9d30-717f-4d52-a2da-3e4dd63f9e3d req-f4aac76f-dfbc-4c17-a4b1-48653dff8ab5 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078616 Sep 25 01:08:24.434682 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 386/789] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:08:24.915726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:24.916325 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:24.923745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:24.924240 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:24.924720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:24.925441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:24.925980 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:24.926455 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:25.119499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:25.131379 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5b6c3d3c-a347-4268-950b-0a8f2371f7cb tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1314 microversion: 2.1 time: 0.219610 Sep 25 01:08:25.132638 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 404/790] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:24 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:26.156637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:26.157379 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:26.165173 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:26.165681 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:26.166128 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:26.166860 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:26.167325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:26.167758 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:26.326710 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:26.336466 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-66618a86-9147-4fe6-bdb1-26f17fb93ff2 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1314 microversion: 2.1 time: 0.184005 Sep 25 01:08:26.337109 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 387/791] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:26 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:27.360909 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:27.361623 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:27.369381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:27.369888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:27.370485 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:27.371221 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:27.371675 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:27.372297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:27.582230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:27.597279 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a7ce7519-6b31-43b9-9530-fbda0cff46f8 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1314 microversion: 2.1 time: 0.240027 Sep 25 01:08:27.598369 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 405/792] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:27 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1314 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:28.637425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:28.638215 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:28.646429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:28.646933 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:28.647640 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:28.648996 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:28.649830 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:28.650607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:28.846616 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:28.859031 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-23f1139e-cfc0-477b-b5c0-afaad197656a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1314 microversion: 2.1 time: 0.225672 Sep 25 01:08:28.859930 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 388/793] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:28 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:29.886396 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:29.887314 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:29.889830 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:29.891118 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=6 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:29.898801 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:29.899298 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:29.899754 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:29.900523 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:29.900991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:29.901423 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:30.117660 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:30.134854 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a235bb5c-5ec2-4588-99a7-66a18530ffc7 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1314 microversion: 2.1 time: 0.252269 Sep 25 01:08:30.136300 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 406/794] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:29 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1314 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:30.428823 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-aa88ee38-c2f8-47cf-a5ef-c006ea1e680e req-9176cefe-488a-4dd4-b5de-ec344fda3c59 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd2fde1-018a-4f18-b324-4bf74c6747fd", "name": "network-vif-plugged", "status": "completed", "tag": "3c2cd66b-96d9-41ab-8400-a26fbb63f062"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:30.435945 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:30.445964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-aa88ee38-c2f8-47cf-a5ef-c006ea1e680e req-9176cefe-488a-4dd4-b5de-ec344fda3c59 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:30.446632 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-aa88ee38-c2f8-47cf-a5ef-c006ea1e680e req-9176cefe-488a-4dd4-b5de-ec344fda3c59 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:30.447496 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-aa88ee38-c2f8-47cf-a5ef-c006ea1e680e req-9176cefe-488a-4dd4-b5de-ec344fda3c59 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:30.465647 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-aa88ee38-c2f8-47cf-a5ef-c006ea1e680e req-9176cefe-488a-4dd4-b5de-ec344fda3c59 service nova] Creating event network-vif-plugged:3c2cd66b-96d9-41ab-8400-a26fbb63f062 for instance dbd2fde1-018a-4f18-b324-4bf74c6747fd on hv-cinder-maste Sep 25 01:08:30.472546 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-aa88ee38-c2f8-47cf-a5ef-c006ea1e680e req-9176cefe-488a-4dd4-b5de-ec344fda3c59 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048101 Sep 25 01:08:30.473537 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 389/795] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:08:31.178288 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:31.179160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:31.187428 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:31.188668 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:31.189270 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:31.190088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:31.190686 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:31.191163 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:31.427924 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:31.442841 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1b7128e2-947a-41e1-a8dc-eada41b7370f tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1314 microversion: 2.1 time: 0.268864 Sep 25 01:08:31.443633 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 407/796] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:31 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:32.485738 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:32.487091 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:32.496761 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:32.497272 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:32.497732 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:32.498574 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:32.499084 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:32.499557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:32.670495 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:32.680642 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e817bc1b-2c3c-4ccd-aad5-b55fd28841d6 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1499 microversion: 2.1 time: 0.204049 Sep 25 01:08:32.681360 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 390/797] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:32 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1499 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:35.734036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:35.734869 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:35.747992 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.748922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.749710 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:35.751616 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.752505 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.753288 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:35.799126 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:08:35.967622 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-458489d6-aa34-4c91-9abf-36e65944bc41 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 204 len: 0 microversion: 2.1 time: 0.241109 Sep 25 01:08:35.968068 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 408/798] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:08:35 2022] DELETE /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:08:35.979736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:35.980641 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:35.988328 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.988757 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.989209 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:35.989948 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:35.990415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:35.990847 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:36.154974 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:36.164498 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-39bb2871-d6dc-4360-9912-4723e598d923 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1505 microversion: 2.1 time: 0.189713 Sep 25 01:08:36.165123 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 391/799] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:35 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1505 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:08:37.197793 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:37.199195 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:37.216232 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:37.217329 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:37.218256 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:37.220460 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:37.221377 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:37.222183 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:37.473049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:37.490710 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4fed05be-761b-45e0-aa7b-31e88aeb2922 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1505 microversion: 2.1 time: 0.300925 Sep 25 01:08:37.491850 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 409/800] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:37 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1505 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:38.542707 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:38.551139 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:38.566750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:38.567675 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:38.568564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:38.569936 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:38.570817 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:38.571632 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:38.649647 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-9aa87d25-4d7f-4bcb-83e3-aeaf6da4d1ea req-39af5b07-0ea6-4bdc-8938-ef980ef67bbd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dbd2fde1-018a-4f18-b324-4bf74c6747fd", "name": "network-vif-deleted", "tag": "3c2cd66b-96d9-41ab-8400-a26fbb63f062"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:38.671256 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9aa87d25-4d7f-4bcb-83e3-aeaf6da4d1ea req-39af5b07-0ea6-4bdc-8938-ef980ef67bbd service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:38.672430 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9aa87d25-4d7f-4bcb-83e3-aeaf6da4d1ea req-39af5b07-0ea6-4bdc-8938-ef980ef67bbd service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:38.673499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-9aa87d25-4d7f-4bcb-83e3-aeaf6da4d1ea req-39af5b07-0ea6-4bdc-8938-ef980ef67bbd service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:38.706193 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-9aa87d25-4d7f-4bcb-83e3-aeaf6da4d1ea req-39af5b07-0ea6-4bdc-8938-ef980ef67bbd service nova] Creating event network-vif-deleted:3c2cd66b-96d9-41ab-8400-a26fbb63f062 for instance dbd2fde1-018a-4f18-b324-4bf74c6747fd on hv-cinder-maste Sep 25 01:08:38.706758 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:38.716251 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-9aa87d25-4d7f-4bcb-83e3-aeaf6da4d1ea req-39af5b07-0ea6-4bdc-8938-ef980ef67bbd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074044 Sep 25 01:08:38.717381 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 410/801] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:08:38.726717 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bab3ea30-5c11-471a-9d33-12e2aaa787d5 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1463 microversion: 2.1 time: 0.204162 Sep 25 01:08:38.727779 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 392/802] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:38 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1463 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:39.366984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:39.368224 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:39.387945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:39.388305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:39.389286 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:39.390720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:39.391781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:39.392806 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:39.429530 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4357c301-3eeb-4386-b951-56a5de7439f1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/ips" status: 200 len: 150 microversion: 2.20 time: 0.070876 Sep 25 01:08:39.430148 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 411/803] 10.222.0.26 () {60 vars in 1289 bytes} [Sun Sep 25 01:08:39 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/ips => generated 150 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:08:39.769181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:39.770951 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:39.787019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:39.788506 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:39.789462 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:39.790804 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:39.791687 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:39.792508 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:39.846557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:39.847241 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:39.848113 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:39.848113 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lazy-loading 'fault' on Instance uuid dbd2fde1-018a-4f18-b324-4bf74c6747fd {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:39.913268 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd584320fc5044638914728ab9d050fc4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '37c3708702654977b6b7bbb104255e3f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:39.927209 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c9e02747-6963-4c4e-bd5a-2a7919cdb008 tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 200 len: 1304 microversion: 2.1 time: 0.165681 Sep 25 01:08:39.928063 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 393/804] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:39 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 1304 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:08:40.954020 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:40.954931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] [instance: dbd2fde1-018a-4f18-b324-4bf74c6747fd] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:40.962693 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:40.963195 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:40.963702 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:40.964477 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:40.964880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:40.965313 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:40.982196 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] HTTP exception thrown: Instance dbd2fde1-018a-4f18-b324-4bf74c6747fd could not be found. Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Request method failure captured: Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd HTTP/1.1 Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6oAWM1y0dhgxRH1W_68b8CGZ6rt5jMrd_zmiN0yclCpRiQv1nvryv2jCeZtxT7ZdYipcUlN8uB8BvDvObj7lmIsou9xLZEcrYUMHBzMGtRsDR4WA3TOQsp25cjM2-7163a6En2vkS3-UlyYsQz6xCVHvuLI0c-hF_y5K_dIfWVoOYw Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 37c3708702654977b6b7bbb104255e3f Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-VolumesActionsTest-2014493302 Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:08:40.985731 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_37c3708702654977b6b7bbb104255e3f", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/37c3708702654977b6b7bbb104255e3f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37c3708702654977b6b7bbb104255e3f"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/37c3708702654977b6b7bbb104255e3f"}]}] Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-VolumesActionsTest-2014493302 Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 37c3708702654977b6b7bbb104255e3f Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-VolumesActionsTest-2014493302 Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-VolumesActionsTest-2014493302-project Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: d584320fc5044638914728ab9d050fc4 Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-VolumesActionsTest-2014493302-project Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance dbd2fde1-018a-4f18-b324-4bf74c6747fd could not be found. Sep 25 01:08:40.988789 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': 'dbd2fde1-018a-4f18-b324-4bf74c6747fd'} Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dbd2fde1-018a-4f18-b324-4bf74c6747fd could not be found. Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:08:40.990408 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dbd2fde1-018a-4f18-b324-4bf74c6747fd could not be found. Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dbd2fde1-018a-4f18-b324-4bf74c6747fd could not be found. Sep 25 01:08:40.994166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:08:40.996986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] Returning 404 to user: Instance dbd2fde1-018a-4f18-b324-4bf74c6747fd could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:08:40.996986 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0d0bbf3f-0ec2-49fb-a273-acc571d2dc5a tempest-VolumesActionsTest-2014493302 tempest-VolumesActionsTest-2014493302-project] 10.222.0.26 "GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd" status: 404 len: 111 microversion: 2.1 time: 0.042167 Sep 25 01:08:40.996986 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 412/805] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:08:40 2022] GET /compute/v2.1/servers/dbd2fde1-018a-4f18-b324-4bf74c6747fd => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:08:41.965643 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:41.966624 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:41.980619 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:41.981964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:41.983105 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:41.985626 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:41.986964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:41.987631 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:42.272793 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lazy-loading 'flavor' on Instance uuid 860527d0-4a7d-421f-8326-1d565c5f9f8f {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:08:42.555477 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-614b2d2b-bffe-4b7c-996d-27d70a24b62d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/action" status: 202 len: 0 microversion: 2.20 time: 0.597180 Sep 25 01:08:42.556519 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 394/806] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Sep 25 01:08:41 2022] POST /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/action => generated 0 bytes in 600 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:08:42.569842 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:42.572123 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:42.584858 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:42.586364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:42.587321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:42.588818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:42.589775 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:42.590890 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:42.835615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:42.851900 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:42.854208 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:42.855803 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-64d0422b-0a10-4bed-91aa-c2f3490de86a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.294176 Sep 25 01:08:42.856740 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 413/807] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:42 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:08:43.884435 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:43.885217 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:43.893567 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:43.894062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:43.894498 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:43.895212 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:43.895658 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:43.896079 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:44.097275 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:44.107163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:44.108701 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:44.110013 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2e044c48-8749-479d-84eb-75aa7199f720 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.230594 Sep 25 01:08:44.124414 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 395/808] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:43 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:08:45.139961 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:45.141315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:45.148666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:45.149162 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:45.149597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:45.150404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:45.151094 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:45.151533 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:45.352441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:45.368456 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:45.371449 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:45.373769 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ec2e07fa-541f-4a19-a080-30dd9869ee1f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.237961 Sep 25 01:08:45.374812 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 414/809] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:45 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:46.417096 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:46.417733 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:46.424692 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:46.425191 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:46.425667 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:46.426398 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:46.426883 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:46.427333 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:46.635502 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:46.644847 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:46.646401 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:46.647645 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-01ba6b07-a2a7-4097-8528-59754adebdd2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.234854 Sep 25 01:08:46.648219 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 396/810] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:46 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:47.675406 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:47.676048 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:47.683257 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:47.683746 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:47.684180 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:47.684937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:47.685390 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:47.685844 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:47.907892 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:47.918116 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:47.920000 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:47.921296 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-92ee0b11-f246-4302-a574-a7afa8a27416 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.250559 Sep 25 01:08:47.921986 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 415/811] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:47 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:48.948078 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:48.948937 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:48.957957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:48.958621 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:48.959186 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:48.960018 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:48.960647 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:48.961182 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:49.125282 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:49.134855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:49.136656 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:49.138032 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3f76efa4-fe06-4d56-bae5-2070bfb42b4f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.194457 Sep 25 01:08:49.138653 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 397/812] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:48 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:08:50.167042 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:50.167938 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:50.170981 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:50.176764 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:50.177264 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:50.177714 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:50.178448 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:50.178914 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:50.179353 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:50.183799 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:50.371911 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:50.387517 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:50.391365 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:50.393931 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d36fc7eb-f0aa-41d7-aa3f-e3d85e4d3b72 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.231477 Sep 25 01:08:50.394845 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 416/813] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:50 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:51.424682 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:51.425708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:51.428881 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=33 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:51.435720 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:51.436531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:51.437670 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:51.438659 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:51.439351 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:51.439877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:51.443545 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:08:51.615587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:51.632514 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:51.635703 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:51.637891 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5f0b13b4-570e-452a-8d86-2508af6891a5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.220494 Sep 25 01:08:51.638787 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 398/814] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:51 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:52.668821 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:52.669526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:52.677950 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:52.678979 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:52.679471 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:52.680175 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:52.680681 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:52.681130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:52.904205 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:52.916184 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:52.918472 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:52.920360 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8529d6a0-5fec-4ab4-b8b8-578ea207f5cc tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.256615 Sep 25 01:08:52.921624 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 417/815] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:52 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:53.966447 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:53.967399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:53.978934 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:53.979765 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:53.980551 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:53.981849 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:53.982659 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:53.983353 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:54.201393 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:54.220473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:54.221637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:54.222968 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-93a9d56a-c5c6-4be3-bb89-f3f87c48783c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.263667 Sep 25 01:08:54.223556 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 399/816] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:53 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:55.251921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:55.252724 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:55.259266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:55.259752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:55.260194 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:55.260950 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:55.261429 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:55.261834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:55.406934 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:55.417888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:55.417888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:55.419551 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1d185dd5-b7a7-44f7-b89c-d50015fecd8f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1742 microversion: 2.20 time: 0.172135 Sep 25 01:08:55.420147 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 418/817] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:55 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1742 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:56.446717 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:56.447548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:56.454978 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:56.455545 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:56.455982 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:56.456762 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:56.457586 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:56.458389 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:56.673180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:56.682587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:56.684086 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:56.685348 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b7d8bf78-0374-41ab-bba2-30e2b7f8d7b8 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1742 microversion: 2.20 time: 0.242961 Sep 25 01:08:56.686253 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 400/818] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:56 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1742 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:08:57.711778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:57.712692 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:57.720570 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:57.721106 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:57.721555 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:57.722290 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:57.722745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:57.723167 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:57.959854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:57.980226 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:57.984516 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:57.986922 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f6988846-3f7a-443f-b9c3-627f0fd36991 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1742 microversion: 2.20 time: 0.279049 Sep 25 01:08:57.987959 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 419/819] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:57 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1742 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:08:58.509120 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-5415dc76-01c4-44c8-a9cf-f5f4af869742 req-11d75030-82bf-4f58-84da-a1b02a55df92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860527d0-4a7d-421f-8326-1d565c5f9f8f", "name": "network-vif-plugged", "status": "completed", "tag": "47b9f80d-5f51-4b6e-ba3a-7dc7fe295721"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:08:58.530783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-5415dc76-01c4-44c8-a9cf-f5f4af869742 req-11d75030-82bf-4f58-84da-a1b02a55df92 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:58.531756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-5415dc76-01c4-44c8-a9cf-f5f4af869742 req-11d75030-82bf-4f58-84da-a1b02a55df92 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:58.532417 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-5415dc76-01c4-44c8-a9cf-f5f4af869742 req-11d75030-82bf-4f58-84da-a1b02a55df92 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:58.551032 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-5415dc76-01c4-44c8-a9cf-f5f4af869742 req-11d75030-82bf-4f58-84da-a1b02a55df92 service nova] Creating event network-vif-plugged:47b9f80d-5f51-4b6e-ba3a-7dc7fe295721 for instance 860527d0-4a7d-421f-8326-1d565c5f9f8f on hv-cinder-maste Sep 25 01:08:58.559407 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-5415dc76-01c4-44c8-a9cf-f5f4af869742 req-11d75030-82bf-4f58-84da-a1b02a55df92 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059803 Sep 25 01:08:58.560725 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 401/820] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:08:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:08:59.030921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:08:59.031653 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:08:59.039629 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:59.040128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:59.040609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:59.041344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:08:59.041820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:08:59.042253 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:08:59.212291 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:59.222145 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:59.224210 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:08:59.226277 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c0920797-2407-4ac2-8f12-c692aa59cced tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1742 microversion: 2.20 time: 0.200661 Sep 25 01:08:59.227302 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 420/821] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:08:59 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1742 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:00.260669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:00.261470 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:00.268133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:00.268655 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:00.269095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:00.269814 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:00.270282 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:00.270712 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:00.444138 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:00.455054 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:00.456542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:00.458060 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bceccdbb-6d2a-4fb7-903a-8f445a20ba69 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1742 microversion: 2.20 time: 0.202232 Sep 25 01:09:00.458724 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 402/822] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:00 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1742 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:01.485497 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:01.486359 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:01.495076 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:01.495723 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:01.496284 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:01.497258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:01.497891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:01.498463 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:01.688053 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:01.698695 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:01.700278 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:01.702237 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-66781923-8099-47b4-a032-d34b967d06e2 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.222171 Sep 25 01:09:01.702816 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 421/823] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:01 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:02.732017 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:02.732783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:02.743556 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:02.746705 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:02.748593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:02.749932 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:02.750407 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:02.750923 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:02.962229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:02.982960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:02.984877 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:02.986211 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1b88b1ef-54a5-4b2a-b04f-9c7af5fb0787 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.258578 Sep 25 01:09:02.989453 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 403/824] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:02 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:04.019131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:04.019826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:04.035010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:04.035473 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:04.035910 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:04.036656 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:04.037117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:04.037534 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:04.210507 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:04.228894 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:04.235522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:04.236792 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f627d719-7f78-48ee-b855-e1ce8bccad39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.223076 Sep 25 01:09:04.238542 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 422/825] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:04 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:05.275232 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:05.277426 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:05.317154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:05.317154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:05.317154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:05.317154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:05.317541 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:05.317541 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:05.577420 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:05.590226 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:05.591790 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:05.593203 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-235301f1-b410-4238-9e5d-c3dd2356a6c5 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.325563 Sep 25 01:09:05.593805 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 404/826] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:05 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:06.622588 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:06.624053 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:06.631944 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:06.632454 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:06.633040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:06.633659 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:06.634040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:06.634444 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:06.788305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:06.803110 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:06.806362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:06.809073 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-886678bd-0331-45a3-8a36-ba6448d3e4a1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.190534 Sep 25 01:09:06.813389 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 423/827] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:06 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:07.837285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:07.838134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:07.846626 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.847411 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.847972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:07.848736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:07.849464 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:07.849885 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:08.029731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.042692 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.044433 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:08.046322 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e1f7a8bc-1aa8-4119-ba11-ee06566dc5a6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.213041 Sep 25 01:09:08.047300 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 405/828] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:07 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:09.097475 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:09.099270 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:09.111127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.111925 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.112637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.113745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.119146 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.120417 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.223037 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:09.223896 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:09.236215 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.237057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.237734 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.239055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:09.239615 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:09.240252 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:09.294449 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cb687953-053e-413f-a728-2023636f357b tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/ips" status: 200 len: 146 microversion: 2.1 time: 0.080315 Sep 25 01:09:09.295614 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 406/829] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:09:09 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/ips => generated 146 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:09.464420 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.478972 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.480802 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:09.483592 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-39431b7f-8635-40fb-aeab-2db220af8a6a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.394169 Sep 25 01:09:09.503490 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 424/830] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:09 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:10.518893 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:10.520040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:10.536373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.537341 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.539079 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.540083 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:10.540825 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:10.543087 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:10.783095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.799693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.803193 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:10.810687 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5611a033-19bf-48e3-b5e3-a69818e75e70 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.298062 Sep 25 01:09:10.812216 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 407/831] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:10 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:10.982289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "60ce573c-bbf6-4a1c-86d8-dac9bc6aa7e6"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:10.987572 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:10.999077 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.000202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.001165 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:11.002165 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.002695 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.003252 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:11.486255 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-55c25b92-de50-4a10-bdcb-a5256f5e5b77 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.511194 Sep 25 01:09:11.486937 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 425/832] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:09:10 2022] POST /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments => generated 194 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:11.865178 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:11.868192 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:11.879169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.880118 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.880921 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:11.882237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:11.882714 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:11.883421 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:12.087554 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.105635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.109653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:12.112494 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-18b1d303-63b3-4149-b38b-732fcc80e803 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.268779 Sep 25 01:09:12.114285 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 408/833] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:11 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:13.144408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:13.146333 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:13.156266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.157142 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.157587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:13.158364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.159307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.159916 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:13.519008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:13.538233 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:13.542838 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:13.546311 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-303d0444-32e4-45c0-8c1c-86a3cb564f2e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.406603 Sep 25 01:09:13.547482 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 426/834] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:13 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:13.941361 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:13.945082 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:13.959160 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.961663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.962349 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:13.963659 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:13.965398 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:13.966407 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.031974 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-29d8d716-cef5-4727-8cf3-8ebf4d9d619f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.098341 Sep 25 01:09:14.043141 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 409/835] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:09:13 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments => generated 197 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:14.055134 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:14.058469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:14.074834 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.075402 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.075861 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.076930 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.077567 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.078168 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.116582 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2eee7384-de7f-4b87-a5f4-10737b3f3862 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/60ce573c-bbf6-4a1c-86d8-dac9bc6aa7e6" status: 200 len: 194 microversion: 2.1 time: 0.071306 Sep 25 01:09:14.117788 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 427/836] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Sep 25 01:09:14 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/60ce573c-bbf6-4a1c-86d8-dac9bc6aa7e6 => generated 194 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:14.593656 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:14.595270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:14.609549 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.611519 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.612724 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.616118 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:14.617280 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:14.618480 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:14.880212 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:14.899133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:14.903139 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:14.907112 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-07e7efed-ddb0-407a-8526-dcb3c83835ba tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.321650 Sep 25 01:09:14.911229 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 410/837] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:14 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:15.911494 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "da98d524-cba8-4d28-8913-305d533df335"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:15.914403 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:15.921471 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.921972 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.922405 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.923128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.923585 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.924052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.958457 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:15.959093 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:15.967838 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.968347 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.968825 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:15.969771 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:15.970423 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:15.971023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:16.159810 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:16.173914 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:16.175548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:16.177423 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-88737a0f-9a38-402b-a4e6-e5ee0b56069f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1737 microversion: 2.20 time: 0.223084 Sep 25 01:09:16.178414 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 411/838] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:15 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1737 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:16.429575 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-db2e4261-78e2-422c-abfe-1cdbd147951d tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "POST /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.521763 Sep 25 01:09:16.430479 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 428/839] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:09:15 2022] POST /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments => generated 194 bytes in 524 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:17.206813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:17.207659 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:17.215511 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:17.216154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:17.216901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:17.217699 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:17.218179 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:17.218671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:17.380492 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.391323 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.392739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:17.394412 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4f0b84ea-0b16-4936-afde-89e6ea1d4b5e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1719 microversion: 2.20 time: 0.191267 Sep 25 01:09:17.394818 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 412/840] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:17 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1719 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:18.424358 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:18.425116 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:18.432447 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.433030 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.433474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.434187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:18.434641 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:18.435065 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:18.605368 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.626521 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.629968 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:18.632482 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2c8c479b-f617-40c9-a7c6-ff7f88651156 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1719 microversion: 2.20 time: 0.213684 Sep 25 01:09:18.633701 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 429/841] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:18 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1719 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:19.690629 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:19.692605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:19.701531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:19.702256 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:19.702801 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:19.703637 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:19.704206 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:19.704773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:19.893049 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:19.908278 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:19.911291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:19.913934 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8081f37c-788e-4c13-a216-6e304cfa1b7a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1719 microversion: 2.20 time: 0.228718 Sep 25 01:09:19.914986 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 413/842] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:19 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1719 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:20.600449 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-09d7f002-e6ce-40b7-8448-d16da107bdb6 req-2fd7740b-0cde-446a-829b-7eb8fea4de4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860527d0-4a7d-421f-8326-1d565c5f9f8f", "name": "network-vif-unplugged", "status": "completed", "tag": "47b9f80d-5f51-4b6e-ba3a-7dc7fe295721"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:20.612964 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=28 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:20.623495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-09d7f002-e6ce-40b7-8448-d16da107bdb6 req-2fd7740b-0cde-446a-829b-7eb8fea4de4a service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.624250 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-09d7f002-e6ce-40b7-8448-d16da107bdb6 req-2fd7740b-0cde-446a-829b-7eb8fea4de4a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.625078 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-09d7f002-e6ce-40b7-8448-d16da107bdb6 req-2fd7740b-0cde-446a-829b-7eb8fea4de4a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.633966 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:20.652263 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-09d7f002-e6ce-40b7-8448-d16da107bdb6 req-2fd7740b-0cde-446a-829b-7eb8fea4de4a service nova] Creating event network-vif-unplugged:47b9f80d-5f51-4b6e-ba3a-7dc7fe295721 for instance 860527d0-4a7d-421f-8326-1d565c5f9f8f on hv-cinder-maste Sep 25 01:09:20.664161 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-09d7f002-e6ce-40b7-8448-d16da107bdb6 req-2fd7740b-0cde-446a-829b-7eb8fea4de4a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.070277 Sep 25 01:09:20.666225 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 430/843] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:20 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:20.941887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:20.942852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:20.949795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.950405 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.950986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.951753 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.952686 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.953198 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.959656 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:20.963007 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:20.977320 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.978609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.979540 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:20.981309 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:20.982186 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:20.983283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.030963 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c9410f29-a7fb-4df1-bb5f-1e17e1050625 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.076205 Sep 25 01:09:21.032338 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 431/844] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:09:20 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments => generated 371 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:21.189884 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:21.190469 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:21.197694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.198200 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.198766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.199604 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.200091 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.201087 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.238710 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-cb4cef84-68e1-49f9-abb4-debeebe0c90e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/60ce573c-bbf6-4a1c-86d8-dac9bc6aa7e6" status: 200 len: 194 microversion: 2.1 time: 0.055511 Sep 25 01:09:21.239347 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 432/845] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Sep 25 01:09:21 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/60ce573c-bbf6-4a1c-86d8-dac9bc6aa7e6 => generated 194 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:21.251060 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:21.251577 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:21.258422 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.259571 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.260204 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.261282 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.261497 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:21.261916 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.262388 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.289324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:21.292478 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:21.295477 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7d2c134a-0c40-4798-bfc3-ab0c2a1e03fb tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1722 microversion: 2.20 time: 0.356810 Sep 25 01:09:21.296838 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 414/846] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:20 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1722 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:21.344214 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc198c9c-0022-4ee9-a82b-1dadb35fde6b"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:21.348564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:21.357924 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.358536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.359285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.360044 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:21.360542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:21.360980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:21.548866 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=100 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:21.672676 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lazy-loading 'services' on Instance uuid 24bda589-bfa8-4622-82e5-e6abb0298a27 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:21.770655 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ff55ac8e-ef0c-454b-be66-4118b752f929 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/60ce573c-bbf6-4a1c-86d8-dac9bc6aa7e6" status: 202 len: 0 microversion: 2.1 time: 0.524118 Sep 25 01:09:21.771575 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 433/847] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:09:21 2022] DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/60ce573c-bbf6-4a1c-86d8-dac9bc6aa7e6 => generated 0 bytes in 526 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:09:22.000375 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cf199f83-1b7a-4d22-9967-f2c6e66de0c1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.665266 Sep 25 01:09:22.001290 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 415/848] 10.222.0.26 () {62 vars in 1364 bytes} [Sun Sep 25 01:09:21 2022] POST /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-volume_attachments => generated 188 bytes in 668 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 25 01:09:22.163913 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:22.164550 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:22.171789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.172324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.172820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.173551 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.173999 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.174420 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.559868 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-587fba5e-c4a8-4381-a03a-66ae7969e334 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-volume_attachments/fc198c9c-0022-4ee9-a82b-1dadb35fde6b" status: 202 len: 0 microversion: 2.20 time: 0.400542 Sep 25 01:09:22.560536 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 434/849] 10.222.0.26 () {60 vars in 1457 bytes} [Sun Sep 25 01:09:22 2022] DELETE /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-volume_attachments/fc198c9c-0022-4ee9-a82b-1dadb35fde6b => generated 0 bytes in 402 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:09:22.637936 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:22.638865 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:22.641237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=36 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:22.647832 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.648776 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.649368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.650477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.651032 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.651603 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.698676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120932) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:09:22.799556 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5fa1c15b-7999-4732-8c46-13319dbfdb6b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "POST /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/action" status: 202 len: 0 microversion: 2.20 time: 0.165552 Sep 25 01:09:22.804087 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 416/850] 10.222.0.26 () {62 vars in 1319 bytes} [Sun Sep 25 01:09:22 2022] POST /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:09:22.813505 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:22.814707 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:22.828051 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.829305 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.830803 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:22.832043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:22.833052 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:22.834045 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:23.134774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.153560 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.157090 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:23.160547 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-83119ea4-050d-430c-8451-3c817928ddd4 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1670 microversion: 2.20 time: 0.354603 Sep 25 01:09:23.162110 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 435/851] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:22 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1670 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:24.111397 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.112149 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.119718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.120226 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.120696 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.121484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.121975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.123005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.161623 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c9e7a2d4-98f1-4036-9d48-499ff87449ea tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/da98d524-cba8-4d28-8913-305d533df335" status: 200 len: 194 microversion: 2.1 time: 0.055494 Sep 25 01:09:24.162522 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 417/852] 10.222.0.26 () {58 vars in 1413 bytes} [Sun Sep 25 01:09:24 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/da98d524-cba8-4d28-8913-305d533df335 => generated 194 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:24.183922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.185475 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.196631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.197560 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.198847 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.200175 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.201222 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.202024 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.212005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:24.212803 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:24.223157 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.223949 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.225302 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.226454 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:24.227048 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:24.228512 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:24.361575 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lazy-loading 'services' on Instance uuid 24bda589-bfa8-4622-82e5-e6abb0298a27 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:24.490876 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:24.506376 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:24.509726 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:24.514854 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e10b6855-f61f-4c49-ac7e-93b91d698eda tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.309053 Sep 25 01:09:24.518298 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 418/853] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:24 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:24.548825 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e6951f20-a36f-45aa-b4ed-f5f1b5f81071 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/da98d524-cba8-4d28-8913-305d533df335" status: 202 len: 0 microversion: 2.1 time: 0.372472 Sep 25 01:09:24.550449 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 436/854] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:09:24 2022] DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments/da98d524-cba8-4d28-8913-305d533df335 => generated 0 bytes in 377 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:25.559639 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:25.561977 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:25.574656 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.575617 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.576810 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.578125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.579250 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.580037 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.909314 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:25.914227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:25.927436 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.928337 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.929204 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.930567 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:25.931474 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:25.932278 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:25.999640 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f13bc848-f60c-4ea8-b88b-b46d86f80e8c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.100030 Sep 25 01:09:26.000562 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 437/855] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:09:25 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments => generated 25 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:09:26.211543 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:26.215287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:26.225064 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.225984 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.226942 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.227890 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.228765 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.229464 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.280285 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4b282c38-da0b-47b4-82fa-393e5bc5bf79 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.077204 Sep 25 01:09:26.281688 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 438/856] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:09:26 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27/os-volume_attachments => generated 25 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 25 01:09:26.286200 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:26.324950 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:26.327617 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:26.330036 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f5d02fe6-bfef-47e8-b7c9-e57e0b49b11d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.777548 Sep 25 01:09:26.330646 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 419/857] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:25 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 780 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:26.381788 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:26.382419 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:26.389971 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.390926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.391386 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.392149 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.392641 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.393075 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.423580 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:09:26.551533 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7dd1fea1-b28a-4980-afad-503e730e9294 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 204 len: 0 microversion: 2.1 time: 0.173428 Sep 25 01:09:26.552908 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 439/858] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:09:26 2022] DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:09:26.572507 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:26.577622 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:26.589750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.590435 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.591028 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.591867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:26.592739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:26.593413 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:26.764568 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:26.775897 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-19fe0c6f-dd99-4f03-b741-6eca086f6279 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1673 microversion: 2.1 time: 0.217899 Sep 25 01:09:26.776706 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 420/859] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:26 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1673 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:27.363735 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:27.364790 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:27.375837 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:27.376635 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:27.377401 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:27.378521 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:27.379187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:27.379860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:27.580535 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:27.595888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:27.598847 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:27.601651 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-640f3eeb-dfa4-4bf4-8144-5f587704d792 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.244828 Sep 25 01:09:27.602646 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 440/860] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:27 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:27.806678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:27.807870 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:27.818568 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:27.819109 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:27.819679 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:27.820688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:27.821284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:27.822175 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.006528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:28.016680 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a4e8818a-ae87-4cfc-ad90-367e85298083 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1673 microversion: 2.1 time: 0.219446 Sep 25 01:09:28.017777 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 421/861] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:27 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1673 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:28.641856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:28.642636 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:28.655357 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:28.656227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:28.657931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.658545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:28.659387 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:28.660138 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:28.954428 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:28.965257 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=90,nova_cell1:INSERT=5,nova_cell1:UPDATE=5 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:28.988630 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:28.992185 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:28.995042 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2bb5b28d-319a-48e3-927f-f54281a3eb8e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.360955 Sep 25 01:09:28.996408 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 441/862] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:28 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:29.045050 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:29.046085 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:29.056237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.057203 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.057967 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.059497 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:29.060683 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:29.061400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:29.412499 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:29.427190 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d67b4a49-e780-469f-b543-255ac402a7d6 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1673 microversion: 2.1 time: 0.387120 Sep 25 01:09:29.427817 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 422/863] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:29 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1673 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:30.041680 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:30.043198 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:30.062738 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.065568 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.066383 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.067338 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.071787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.083483 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.385937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:30.413660 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:30.416536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:30.429347 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c7242825-a21b-4c55-a9b0-e8faf22e0b20 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.392520 Sep 25 01:09:30.448570 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 442/864] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:30 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:30.469098 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:30.469098 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:30.479543 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.480324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.480938 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.483402 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:30.484967 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:30.487372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:30.697605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:30.720516 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d38bb560-7070-47e8-bdab-1e4cbbfd7e01 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.263719 Sep 25 01:09:30.729108 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 423/865] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:30 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:30.997926 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-f3acab1d-13f7-4e5c-b021-90de9bf12c3a req-b61d857b-dada-4f61-b357-bcebef190bad service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "24bda589-bfa8-4622-82e5-e6abb0298a27", "name": "network-vif-deleted", "tag": "97378db9-6dd7-40b9-aa76-d8f70e6836fa"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:31.028957 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f3acab1d-13f7-4e5c-b021-90de9bf12c3a req-b61d857b-dada-4f61-b357-bcebef190bad service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.032287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f3acab1d-13f7-4e5c-b021-90de9bf12c3a req-b61d857b-dada-4f61-b357-bcebef190bad service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.038350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-f3acab1d-13f7-4e5c-b021-90de9bf12c3a req-b61d857b-dada-4f61-b357-bcebef190bad service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.083999 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-f3acab1d-13f7-4e5c-b021-90de9bf12c3a req-b61d857b-dada-4f61-b357-bcebef190bad service nova] Creating event network-vif-deleted:97378db9-6dd7-40b9-aa76-d8f70e6836fa for instance 24bda589-bfa8-4622-82e5-e6abb0298a27 on hv-cinder-maste Sep 25 01:09:31.103667 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-f3acab1d-13f7-4e5c-b021-90de9bf12c3a req-b61d857b-dada-4f61-b357-bcebef190bad service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.108683 Sep 25 01:09:31.110086 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 443/866] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:31.494693 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.507663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:31.534824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.536785 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.547163 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.548550 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.549813 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.551606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.776967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:31.781140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:31.807350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.817633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.818880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.820659 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:31.821821 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:31.822856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:31.958293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:31.970185 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:31.975532 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:31.987544 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0b49f5a9-8ade-4774-acb0-12a0ca36b828 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.496248 Sep 25 01:09:31.989766 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 424/867] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:31 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:32.042530 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:32.060541 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7e36a283-2955-434a-8131-f38962264d6c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.291146 Sep 25 01:09:32.072412 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 444/868] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:31 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:33.054853 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:33.055731 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:33.064274 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.065024 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.069139 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.070308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.071065 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.071555 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.128223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:33.132035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:33.145476 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.145476 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.145476 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.145476 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:33.145997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:33.145997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:33.278869 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:33.302595 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8e7a7bd4-0dd7-481e-b09f-618730bc04cd tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.194506 Sep 25 01:09:33.308024 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 445/869] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:33 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:33.468279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:33.480566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:33.483420 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:33.486162 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fcc0513c-1fd7-4c17-b1a8-f9b3869409a3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.443044 Sep 25 01:09:33.487121 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 425/870] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:33 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:34.361211 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:34.362119 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:34.373321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.374480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.375621 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.376812 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.377666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.378347 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.468776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:34.488744 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1ab325fb-1d85-462b-915c-635a9a50590e tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.133096 Sep 25 01:09:34.490190 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 446/871] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:34 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:34.526915 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:34.529675 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:34.549518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.550606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.551580 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.552944 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:34.553787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:34.554461 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:34.764852 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:34.774321 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:34.775917 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:34.777938 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d16fb6e4-4fd1-4708-a2bc-39033e9567e0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.256798 Sep 25 01:09:34.777938 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 426/872] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:34 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:35.541377 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:35.541997 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:35.549183 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:35.549778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:35.550257 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:35.551021 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:35.551529 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:35.551986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:35.632933 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:35.646365 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a3c2aac0-dcf1-49c8-a935-61f04c8cbce5 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.108542 Sep 25 01:09:35.648545 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 447/873] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:35 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:35.810652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:35.811200 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:35.817887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:35.818444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:35.818928 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:35.819854 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:35.820319 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:35.820777 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.029179 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.045822 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.049154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.051802 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cef08cdd-2f30-43f6-b339-8938c9bc5c36 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.248332 Sep 25 01:09:36.052776 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 427/874] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:35 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:36.433931 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:36.434750 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:36.443236 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.445409 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.445866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.448030 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.448532 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.448963 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.477545 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-584c9323-811d-49e2-a390-d430a7c21b2e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/ips" status: 200 len: 149 microversion: 2.1 time: 0.047526 Sep 25 01:09:36.479877 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 448/875] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:09:36 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/ips => generated 149 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:36.671477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:36.672511 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:36.683544 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.686612 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.687585 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.690196 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:36.691094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:36.694784 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:36.851367 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:36.856570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:36.874064 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c25dfb85-2c80-45ad-81d8-28d177828f60 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.206063 Sep 25 01:09:36.877439 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 428/876] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:36 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:37.081080 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:37.084345 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:37.099232 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.100177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.103281 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:37.106687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.108312 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.109253 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:37.447009 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:37.459495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:37.461628 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:37.462818 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-69b11d57-8b94-44e8-9355-36a7b7d1b374 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.386574 Sep 25 01:09:37.464416 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 449/877] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:37 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:37.911871 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:37.913708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:37.940178 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.941016 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.941751 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:37.943633 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:37.945460 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:37.946824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.060034 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.073004 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-31ab80d1-0753-4f5c-aeeb-814bfaeaa26f tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.165311 Sep 25 01:09:38.074116 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 429/878] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:37 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:38.342058 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:38.350524 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:38.367393 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.368401 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.369122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.370741 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.371214 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.372511 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.493963 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:38.494607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:38.501669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.502286 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.502727 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.503445 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:38.503908 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:38.504532 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:38.686140 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.696673 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.698523 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:38.700538 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7d2441ad-f1f2-4185-9e41-bc22c9d4ff0e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.210169 Sep 25 01:09:38.702344 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 430/879] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:38 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:39.097978 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:39.098770 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:39.106106 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.106607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.107051 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.108038 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.108539 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.109510 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.189018 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:39.203518 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bf29a102-7df2-49d5-ab93-eaac0e9b1e52 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.109224 Sep 25 01:09:39.204510 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 431/880] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:39 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:39.729821 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:39.730767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:39.743654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.744247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.744808 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.745649 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:39.746177 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:39.747444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:39.995542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:40.008462 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:40.009996 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:40.011289 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e1b424e1-7d5a-4eb0-af12-8d91e680c848 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.287253 Sep 25 01:09:40.012543 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 432/881] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:39 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:40.242688 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:40.243874 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:40.252287 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:40.252974 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:40.253427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:40.254329 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:40.254826 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:40.255623 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:40.343368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:40.353428 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-003dca1e-00fc-4f50-8d93-bc5548f42722 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.118025 Sep 25 01:09:40.354218 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 433/882] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:40 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:41.048562 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:41.049227 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:41.056966 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.057456 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.057895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.058607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.059654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.060101 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.266151 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.283952 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.288270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.290158 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc54b07c-4de2-49f9-9faa-42f2becc6eec tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.246577 Sep 25 01:09:41.291221 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 434/883] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:41 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:41.383602 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:41.385496 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:41.395713 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.396679 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.397497 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.398631 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:41.399599 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:41.400339 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:41.501148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:41.516773 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d3646336-b377-4979-8f51-975a898121b1 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1605 microversion: 2.1 time: 0.139685 Sep 25 01:09:41.518155 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 435/884] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:41 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1605 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:09:42.336133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:42.337252 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:42.345735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.346444 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.347023 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.347957 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.348623 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.349189 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.527072 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.537169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.539118 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.540499 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ab8c6271-aefd-4ea4-a768-13f7cc35acb0 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.208871 Sep 25 01:09:42.541117 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 436/885] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:42 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:42.547382 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:42.548033 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:42.555276 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.555837 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.556279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.557012 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.557559 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.557993 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.603605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:42.604550 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:42.605148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:42.605720 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lazy-loading 'fault' on Instance uuid 24bda589-bfa8-4622-82e5-e6abb0298a27 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:42.653529 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:42.661991 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3ed164c5-f7c1-4078-b0e4-599c9cd8651c tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1326 microversion: 2.1 time: 0.119732 Sep 25 01:09:42.662851 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 437/886] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:42 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1326 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:43.573391 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:43.574225 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:43.581553 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.582056 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.582514 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.583265 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.583721 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.584160 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.817798 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:43.836662 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:43.839754 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:43.842147 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dedd9e99-04ca-43e5-b839-6c17ac2ff363 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.272468 Sep 25 01:09:43.843244 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 438/887] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:43 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:43.852792 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:43.853968 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:43.865585 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.868635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.868635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.868635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.869371 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.870138 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.934710 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:43.935569 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:43.936356 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:43.937172 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lazy-loading 'fault' on Instance uuid 24bda589-bfa8-4622-82e5-e6abb0298a27 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:44.006427 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:44.016415 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-62083851-404d-4e34-9b82-3b82ffeefa96 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1326 microversion: 2.1 time: 0.171272 Sep 25 01:09:44.017039 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 439/888] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:43 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1326 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:44.665366 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-df40b7d9-964d-42d8-9bc9-d176082f21da tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.330439 Sep 25 01:09:44.666649 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 450/889] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:09:38 2022] POST /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments => generated 194 bytes in 6333 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:44.874663 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:44.875270 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:44.882687 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:44.883184 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:44.883631 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:44.884435 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:44.884898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:44.885335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.063631 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:45.065146 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:45.078757 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:45.080287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:45.081633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.083747 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:45.085034 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:45.086204 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.098978 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:45.113227 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:45.116281 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:45.120882 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-783966c1-f296-4a4c-86f9-81d1ae6f8bf6 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.250345 Sep 25 01:09:45.122856 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 440/890] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:44 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:45.156887 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:45.157395 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:45.157840 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:45.158314 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lazy-loading 'fault' on Instance uuid 24bda589-bfa8-4622-82e5-e6abb0298a27 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:45.222015 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f32c9b07e6234d55b0d4846d44ee6ce6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '537d0a114f314e9b948150001bda642c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:45.232897 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a299c9f6-1b73-4ae0-8486-ca4ba74388c0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 200 len: 1326 microversion: 2.1 time: 0.179868 Sep 25 01:09:45.233983 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 451/891] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:45 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 1326 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:46.159771 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:46.160928 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:46.174126 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:46.174864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:46.175625 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:46.176856 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:46.177678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:46.178450 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:46.260266 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:46.261344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:46.270579 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:46.271230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:46.271814 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:46.272955 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:46.273529 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:46.274186 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:46.293528 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] HTTP exception thrown: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Request method failure captured: Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 HTTP/1.1 Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6g-7R0NPGHnQh-AAfy2wownMEYKMsEkV4BwlpcwarLcgg2BodtBWUGVihfShwYOQcR49baCvI_KJmt4wpQ89LJ3-SyTkCIi7Prd6XftE7SGDhcUrkH0uZzY5HDM_NiyinYiO9oNi5RQb9i-4dKKgYyp319I8sslS-81S1K6IgEk9co Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:09:46.295329 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_537d0a114f314e9b948150001bda642c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/537d0a114f314e9b948150001bda642c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}] Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: f32c9b07e6234d55b0d4846d44ee6ce6 Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:46.297790 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '24bda589-bfa8-4622-82e5-e6abb0298a27'} Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:46.298865 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:46.301555 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:46.304070 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Returning 404 to user: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:46.304070 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e9ab04c7-7272-4d89-88f9-15c1f170a033 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 404 len: 111 microversion: 2.1 time: 0.041245 Sep 25 01:09:46.304070 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 452/892] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:46 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:09:46.312367 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a704749d-5dbd-4edb-89c1-8127f9ec06cf tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '.version_select at 0x7f11817e9dc0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:46.338882 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a704749d-5dbd-4edb-89c1-8127f9ec06cf tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-746516293" status: 202 len: 0 microversion: 2.1 time: 0.036361 Sep 25 01:09:46.340749 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 453/893] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Sep 25 01:09:46 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-746516293 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:09:46.365898 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:46.381829 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:46.383687 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:46.385482 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fb73164b-d4ee-46ad-b613-c0fd4e3da701 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.233038 Sep 25 01:09:46.386272 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 441/894] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:46 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:47.060940 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61"}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:47.069905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.086492 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.087660 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.088479 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.090661 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.091530 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.092327 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.251439 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Invalid volume: volume 67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61 is already attached to instances: 6815476f-37aa-4fc5-a8d2-aee8955e5288 Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: POST /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments HTTP/1.1 Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 74 Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:09:47.254275 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: {"volumeAttachment": {"volumeId": "67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61"}} Sep 25 01:09:47.257195 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Invalid volume: volume 67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61 is already attached to instances: 6815476f-37aa-4fc5-a8d2-aee8955e5288 Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'server_id': '6815476f-37aa-4fc5-a8d2-aee8955e5288', 'body': {'volumeAttachment': {'volumeId': '67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61'}}} Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61 is already attached to instances: 6815476f-37aa-4fc5-a8d2-aee8955e5288 Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:47.258775 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61 is already attached to instances: 6815476f-37aa-4fc5-a8d2-aee8955e5288 Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:47.262332 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61 is already attached to instances: 6815476f-37aa-4fc5-a8d2-aee8955e5288 Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 400 to user: Invalid volume: volume 67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61 is already attached to instances: 6815476f-37aa-4fc5-a8d2-aee8955e5288 {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b990c69e-9dab-4fea-a7e8-bbcc73687530 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.201172 Sep 25 01:09:47.272166 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 454/895] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:09:47 2022] POST /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments => generated 174 bytes in 203 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:09:47.350209 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:47.350783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.358091 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.358599 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.359086 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.359767 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.360223 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.360676 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.423766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:47.424452 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.432860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.433229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.434245 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.435039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.435879 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.436584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.456903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lazy-loading 'services' on Instance uuid 6815476f-37aa-4fc5-a8d2-aee8955e5288 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:47.607847 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-97df52d5-dac6-4066-bfff-a77adb976a08 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments/67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61" status: 202 len: 0 microversion: 2.1 time: 0.260397 Sep 25 01:09:47.609291 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 442/896] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:09:47 2022] DELETE /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments/67e6ea45-f9f2-438b-8fc5-4adf6c0f4a61 => generated 0 bytes in 264 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:47.629236 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:47.631007 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:47.640858 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:47.641381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:47.643947 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:47.645668 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-eed73530-b81f-4e88-ba12-b908668d3313 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.225879 Sep 25 01:09:47.647019 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 455/897] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:47 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:47.658923 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.659546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.660755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.661455 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:47.661787 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:47.662428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:47.726778 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-97357ce7-c7b2-48b8-ac18-834ae7ec102f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.109235 Sep 25 01:09:47.729872 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 443/898] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:09:47 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments => generated 197 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:09:48.702132 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.704333 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.714369 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.716081 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.716829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.718202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.718962 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.719619 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.757782 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:48.764147 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:48.786371 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.789122 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.805285 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.810834 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.812188 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.812859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:48.834255 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:48.916175 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-98d29649-a455-4cae-802f-60711608d998 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.172600 Sep 25 01:09:48.917183 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 444/899] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288/os-volume_attachments => generated 25 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:09:48.928035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.943689 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.946427 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:48.947979 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d4a2978c-ab92-4b2d-9bda-f372fdf64a1b tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.251405 Sep 25 01:09:48.948585 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 456/900] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:48 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:48.981368 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-ab4b75df-eb86-4c2d-b122-945e4ecb064c req-4ccc6282-275c-43ec-b602-9fefc1ff025a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860527d0-4a7d-421f-8326-1d565c5f9f8f", "name": "network-vif-plugged", "status": "completed", "tag": "47b9f80d-5f51-4b6e-ba3a-7dc7fe295721"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:48.993359 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ab4b75df-eb86-4c2d-b122-945e4ecb064c req-4ccc6282-275c-43ec-b602-9fefc1ff025a service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:48.993882 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ab4b75df-eb86-4c2d-b122-945e4ecb064c req-4ccc6282-275c-43ec-b602-9fefc1ff025a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:48.994566 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-ab4b75df-eb86-4c2d-b122-945e4ecb064c req-4ccc6282-275c-43ec-b602-9fefc1ff025a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.011192 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-ab4b75df-eb86-4c2d-b122-945e4ecb064c req-4ccc6282-275c-43ec-b602-9fefc1ff025a service nova] Creating event network-vif-plugged:47b9f80d-5f51-4b6e-ba3a-7dc7fe295721 for instance 860527d0-4a7d-421f-8326-1d565c5f9f8f on hv-cinder-maste Sep 25 01:09:49.019139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:49.020274 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.020943 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-ab4b75df-eb86-4c2d-b122-945e4ecb064c req-4ccc6282-275c-43ec-b602-9fefc1ff025a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043300 Sep 25 01:09:49.022488 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 445/901] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:49.030709 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.030709 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.031147 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.031813 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.032279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.033166 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.085066 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:09:49.148817 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:49.188791 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6c32e321-826e-4373-bb72-ce939eb8d8a1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 204 len: 0 microversion: 2.1 time: 0.178676 Sep 25 01:09:49.189792 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 457/902] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:09:49 2022] DELETE /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:09:49.203628 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:49.206108 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.219763 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.220991 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.222127 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.223795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.225070 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.226247 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.434335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:49.450033 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a2e2d4ab-db47-465f-bf8c-2bd165ad6436 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1680 microversion: 2.1 time: 0.252281 Sep 25 01:09:49.451007 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 446/903] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:49 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1680 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:49.615185 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:49.616091 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.624917 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.625504 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.626027 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.626873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.627407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.627882 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.643825 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] HTTP exception thrown: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Request method failure captured: Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 HTTP/1.1 Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6g-7R0NPGHnQh-AAfy2wownMEYKMsEkV4BwlpcwarLcgg2BodtBWUGVihfShwYOQcR49baCvI_KJmt4wpQ89LJ3-SyTkCIi7Prd6XftE7SGDhcUrkH0uZzY5HDM_NiyinYiO9oNi5RQb9i-4dKKgYyp319I8sslS-81S1K6IgEk9co Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:09:49.645730 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_537d0a114f314e9b948150001bda642c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/537d0a114f314e9b948150001bda642c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}] Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: f32c9b07e6234d55b0d4846d44ee6ce6 Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.647529 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '24bda589-bfa8-4622-82e5-e6abb0298a27'} Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:49.648633 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.650527 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.652314 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Returning 404 to user: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:49.652314 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-95eb93ff-047d-4aba-a33b-d95c2910b5d0 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 404 len: 111 microversion: 2.1 time: 0.038394 Sep 25 01:09:49.652314 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 458/904] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:09:49 2022] DELETE /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:09:49.656835 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:49.657524 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 24bda589-bfa8-4622-82e5-e6abb0298a27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.664263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.664796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.665231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.665944 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.666461 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.666856 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.684632 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] HTTP exception thrown: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Request method failure captured: Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 HTTP/1.1 Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6g-7R0NPGHnQh-AAfy2wownMEYKMsEkV4BwlpcwarLcgg2BodtBWUGVihfShwYOQcR49baCvI_KJmt4wpQ89LJ3-SyTkCIi7Prd6XftE7SGDhcUrkH0uZzY5HDM_NiyinYiO9oNi5RQb9i-4dKKgYyp319I8sslS-81S1K6IgEk9co Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:09:49.686344 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_537d0a114f314e9b948150001bda642c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/537d0a114f314e9b948150001bda642c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}] Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: f32c9b07e6234d55b0d4846d44ee6ce6 Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.688161 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '24bda589-bfa8-4622-82e5-e6abb0298a27'} Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:49.688991 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. Sep 25 01:09:49.690216 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:49.691304 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Returning 404 to user: Instance 24bda589-bfa8-4622-82e5-e6abb0298a27 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:49.691304 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7d318c1e-595e-406e-9f5e-9b53813bced9 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27" status: 404 len: 111 microversion: 2.1 time: 0.035593 Sep 25 01:09:49.691304 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 447/905] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:49 2022] GET /compute/v2.1/servers/24bda589-bfa8-4622-82e5-e6abb0298a27 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:49.974787 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:49.975703 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:49.984203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.984818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.985310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:49.986297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:49.987103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:49.987657 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.152947 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:50.162056 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:50.163767 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:50.165134 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8191d151-bc22-452e-a00b-53e451e702e9 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.195009 Sep 25 01:09:50.165704 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 459/906] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:49 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:09:50.483586 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:50.484609 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:50.495912 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.496494 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.497029 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.497904 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.498709 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.499325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.680146 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:50.688852 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7836615b-9d13-4924-974d-78ea7c1c098a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1680 microversion: 2.1 time: 0.211366 Sep 25 01:09:50.689438 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 448/907] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:50 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1680 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:50.889389 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:50.889942 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:50.892008 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:50.897930 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.898553 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.898888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.899667 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.900086 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.900558 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.921606 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] HTTP exception thrown: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Request method failure captured: Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: DELETE /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 HTTP/1.1 Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6g-7R0NPGHnQh-AAfy2wownMEYKMsEkV4BwlpcwarLcgg2BodtBWUGVihfShwYOQcR49baCvI_KJmt4wpQ89LJ3-SyTkCIi7Prd6XftE7SGDhcUrkH0uZzY5HDM_NiyinYiO9oNi5RQb9i-4dKKgYyp319I8sslS-81S1K6IgEk9co Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:09:50.923213 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_537d0a114f314e9b948150001bda642c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/537d0a114f314e9b948150001bda642c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}] Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: f32c9b07e6234d55b0d4846d44ee6ce6 Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.925536 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '16136bd2-3934-43b5-a833-3025f5bc3079'} Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:50.926736 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.928932 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.931528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Returning 404 to user: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:50.931528 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-08e7bb67-b2f8-4820-ad63-5ce868a18adc tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "DELETE /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 404 len: 111 microversion: 2.1 time: 0.039466 Sep 25 01:09:50.931528 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 460/908] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:09:50 2022] DELETE /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:50.934913 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:50.935640 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] [instance: 16136bd2-3934-43b5-a833-3025f5bc3079] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:50.942581 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.943075 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.943516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.944245 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:50.944733 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:50.945164 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:50.960950 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] HTTP exception thrown: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Request method failure captured: Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 HTTP/1.1 Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6g-7R0NPGHnQh-AAfy2wownMEYKMsEkV4BwlpcwarLcgg2BodtBWUGVihfShwYOQcR49baCvI_KJmt4wpQ89LJ3-SyTkCIi7Prd6XftE7SGDhcUrkH0uZzY5HDM_NiyinYiO9oNi5RQb9i-4dKKgYyp319I8sslS-81S1K6IgEk9co Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:09:50.962743 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_537d0a114f314e9b948150001bda642c", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/537d0a114f314e9b948150001bda642c"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/537d0a114f314e9b948150001bda642c"}]}] Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 537d0a114f314e9b948150001bda642c Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1247744662 Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: f32c9b07e6234d55b0d4846d44ee6ce6 Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeTestJSON-1247744662-project Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.966010 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '16136bd2-3934-43b5-a833-3025f5bc3079'} Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:50.967416 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. Sep 25 01:09:50.972850 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:09:50.975503 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] Returning 404 to user: Instance 16136bd2-3934-43b5-a833-3025f5bc3079 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:50.975503 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b9d23a3b-9261-4440-96af-0b950eb50e24 tempest-AttachVolumeTestJSON-1247744662 tempest-AttachVolumeTestJSON-1247744662-project] 10.222.0.26 "GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079" status: 404 len: 111 microversion: 2.1 time: 0.034123 Sep 25 01:09:50.975503 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 449/909] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:50 2022] GET /compute/v2.1/servers/16136bd2-3934-43b5-a833-3025f5bc3079 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:51.196425 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:51.197602 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:51.210385 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.211267 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.212067 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.213416 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.214261 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.215032 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.437952 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:51.447385 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:51.449557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:51.450843 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e1372129-2818-4225-b1c5-09bd7143d60f tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.262733 Sep 25 01:09:51.451637 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 461/910] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:51 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:51.716302 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:51.717451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:51.725386 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.726016 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.726715 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:51.727755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:51.728228 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:51.728698 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.000831 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.013175 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-4e0ef869-0459-416d-8247-57e83cab29ef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1680 microversion: 2.1 time: 0.302943 Sep 25 01:09:52.013929 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 450/911] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:51 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1680 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:52.481409 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:52.482610 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:52.497389 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.498468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.499401 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.500948 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:52.502189 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:52.502977 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:52.688302 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.697131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.699682 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:52.701226 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-8797d500-7945-4f30-a5bf-0f040b644d25 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.227746 Sep 25 01:09:52.702024 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 462/912] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:52 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:53.047708 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:53.048338 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:53.051173 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:09:53.057425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.057928 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.058889 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.059617 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.060078 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.060562 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.695820 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:53.708261 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-fdadf719-f99a-4e22-b4cd-f4b8e30e61c1 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1680 microversion: 2.1 time: 0.664608 Sep 25 01:09:53.724663 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 451/913] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:53 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1680 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:53.736529 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:53.738757 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:53.747354 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.747796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.749108 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:53.749761 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:53.750468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:53.751116 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.143854 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.158774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.160468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.166212 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f0cac0d0-af4c-44f4-88d0-94b275c80729 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1728 microversion: 2.20 time: 0.436809 Sep 25 01:09:54.167162 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 463/914] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:53 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1728 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:54.302513 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-b0809d65-b2f0-4900-8a58-bb67d688635c req-1a0b1f6d-6014-4bf6-b15c-ce05eacc19e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6815476f-37aa-4fc5-a8d2-aee8955e5288", "name": "network-vif-deleted", "tag": "a7a24556-e0e6-4b12-aa94-d3eae8c8733c"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:54.356194 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b0809d65-b2f0-4900-8a58-bb67d688635c req-1a0b1f6d-6014-4bf6-b15c-ce05eacc19e4 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.357049 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b0809d65-b2f0-4900-8a58-bb67d688635c req-1a0b1f6d-6014-4bf6-b15c-ce05eacc19e4 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.357916 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b0809d65-b2f0-4900-8a58-bb67d688635c req-1a0b1f6d-6014-4bf6-b15c-ce05eacc19e4 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.386032 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-b0809d65-b2f0-4900-8a58-bb67d688635c req-1a0b1f6d-6014-4bf6-b15c-ce05eacc19e4 service nova] Creating event network-vif-deleted:a7a24556-e0e6-4b12-aa94-d3eae8c8733c for instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 on hv-cinder-maste Sep 25 01:09:54.400749 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-b0809d65-b2f0-4900-8a58-bb67d688635c req-1a0b1f6d-6014-4bf6-b15c-ce05eacc19e4 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103846 Sep 25 01:09:54.402947 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 452/915] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:09:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:54.732154 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:54.732875 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:54.758307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.759659 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.760316 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.762040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.762991 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.763706 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.807721 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:54.809012 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:54.809534 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:54.810009 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lazy-loading 'fault' on Instance uuid 6815476f-37aa-4fc5-a8d2-aee8955e5288 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:09:54.865127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:54.880767 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-fdf73861-a4b4-405c-83fd-818f43a706dc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 200 len: 1331 microversion: 2.1 time: 0.152561 Sep 25 01:09:54.881817 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 464/916] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:54 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 1331 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:09:55.198152 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:55.203818 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:55.229925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.230529 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.230980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.231742 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.232220 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.232740 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.438518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:55.448237 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:55.450438 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:55.451730 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-29d0013d-21af-401d-8464-908fc3167c09 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1715 microversion: 2.20 time: 0.260866 Sep 25 01:09:55.452305 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 453/917] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:09:55 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1715 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:09:55.910820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:55.913762 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:55.926388 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.938609 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.939562 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.940949 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:55.942412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:55.943091 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:55.981318 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 HTTP/1.1 Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:09:55.983109 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:09:55.984623 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '6815476f-37aa-4fc5-a8d2-aee8955e5288'} Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:09:55.989290 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:09:55.992068 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:09:55.996633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:09:55.998747 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2191a503-5d95-49ee-8bc3-5a4242c67c2f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 404 len: 111 microversion: 2.1 time: 0.094681 Sep 25 01:09:56.008583 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 465/918] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:55 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 111 bytes in 101 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:09:56.009240 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b4a832f0-da1e-48f7-8a0e-f93257930fa9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '.version_select at 0x7f118149edc0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:56.014091 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR oslo.messaging._drivers.impl_rabbit [None req-b4a832f0-da1e-48f7-8a0e-f93257930fa9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [bf51f03f-09e1-4b9d-9a9d-387f4eb677c1] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:09:57.022525 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [None req-b4a832f0-da1e-48f7-8a0e-f93257930fa9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [bf51f03f-09e1-4b9d-9a9d-387f4eb677c1] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 58186. Sep 25 01:09:57.044605 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b4a832f0-da1e-48f7-8a0e-f93257930fa9 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-965351424" status: 202 len: 0 microversion: 2.1 time: 1.039524 Sep 25 01:09:57.045243 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 454/919] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Sep 25 01:09:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-965351424 => generated 0 bytes in 1041 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:09:57.748548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-00833c2f-fd65-4c5c-8380-18451655033e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: .version_select at 0x7f11813e6310>, body: {"keypair": {"name": "tempest-keypair-581571451", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+7GmrZLJfgq9jX70mfTW9CsU/NtgkX8y3pCBgcyM3xqlOQV1pKjAHtd8b2tmBG5LTZu/vOA5E/q+DJglk5DLBLhuRfEjY2JX/nJURJrL+VpJNUeWHCyvTHdnRIn8Y6QQ=="}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:57.768084 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-00833c2f-fd65-4c5c-8380-18451655033e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:57.772935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-00833c2f-fd65-4c5c-8380-18451655033e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:57.797629 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-00833c2f-fd65-4c5c-8380-18451655033e tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.053591 Sep 25 01:09:57.798239 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 466/920] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:09:57 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:09:59.251389 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-763929613", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b"}], "security_groups": [{"name": "tempest-securitygroup--995869348"}], "key_name": "tempest-keypair-581571451", "user_data": "}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:09:59.379951 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] validate_networks() for [('3c1af3cd-ec3e-4aeb-ac62-d7d29b37b37b', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:09:59.796987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:09:59.797411 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:09:59.797998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:09:59.798371 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:09:59.799052 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:09:59.808669 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.809450 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.809870 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.810599 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:09:59.811051 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:09:59.811475 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:09:59.832949 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:09:59.837219 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Getting quotas for user 9d73ba36238f449dbe08d8888920510f and project b388fc6841ed4e5598fba4e8856b7af5. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:09:59.848993 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:09:59.851296 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:09:59.903592 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-85b5e9f3-c6f4-4100-b2b8-4e3c660956cc tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.657175 Sep 25 01:09:59.904635 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 455/921] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:09:59 2022] POST /compute/v2.1/servers => generated 401 bytes in 659 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:09:59.917187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2bad2dbe-5e9d-4f4a-b3e1-bce42508b2ca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:09:59.918412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2bad2dbe-5e9d-4f4a-b3e1-bce42508b2ca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:09:59.988786 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2bad2dbe-5e9d-4f4a-b3e1-bce42508b2ca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:09:59.997059 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2bad2dbe-5e9d-4f4a-b3e1-bce42508b2ca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1240 microversion: 2.1 time: 0.084735 Sep 25 01:09:59.998023 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 467/922] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:09:59 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1240 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:01.022548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:01.023592 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:01.030742 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.031307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.031773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.032858 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:01.033317 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:01.033997 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:01.119936 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:01.133095 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6178f474-db7e-475d-a0b2-36d9a8519510 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1292 microversion: 2.1 time: 0.115054 Sep 25 01:10:01.133694 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 456/923] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:01 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1292 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:02.161088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:02.162747 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:02.174303 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.175277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.176016 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.177642 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:02.178912 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:02.179718 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:02.441332 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:02.453894 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3a0f561b-d290-4689-9769-10ad58f3434f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1365 microversion: 2.1 time: 0.298285 Sep 25 01:10:02.460039 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 468/924] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:02 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1365 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:03.156834 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-d9bb4014-2134-4910-a307-8289745b740d req-c8056382-058c-4000-bd09-b791ca31c1fd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8770505-4fb4-4ca4-a04e-dc81a0770a3f", "tag": "8932c24d-6a85-44cf-a827-ce7a13d1d518"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:03.178749 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d9bb4014-2134-4910-a307-8289745b740d req-c8056382-058c-4000-bd09-b791ca31c1fd service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.179631 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d9bb4014-2134-4910-a307-8289745b740d req-c8056382-058c-4000-bd09-b791ca31c1fd service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.180465 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-d9bb4014-2134-4910-a307-8289745b740d req-c8056382-058c-4000-bd09-b791ca31c1fd service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.200833 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-d9bb4014-2134-4910-a307-8289745b740d req-c8056382-058c-4000-bd09-b791ca31c1fd service nova] Creating event network-changed:8932c24d-6a85-44cf-a827-ce7a13d1d518 for instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f on hv-cinder-maste Sep 25 01:10:03.206512 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-d9bb4014-2134-4910-a307-8289745b740d req-c8056382-058c-4000-bd09-b791ca31c1fd service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059123 Sep 25 01:10:03.207057 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 457/925] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:03.482331 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:03.483137 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:03.490408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.490896 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.491339 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.492048 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:03.492555 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:03.492976 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:03.652705 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:03.661229 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0cdd72a0-1fbd-4881-adc5-634bb1b6639b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1365 microversion: 2.1 time: 0.183705 Sep 25 01:10:03.662171 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 469/926] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:03 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1365 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:04.689518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:04.690571 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:04.697565 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.698548 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.699484 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.699785 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:04.700249 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:04.700700 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:04.842287 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:04.850403 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9891b39e-d692-4e13-abf9-cebcc56fa4eb tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1365 microversion: 2.1 time: 0.169064 Sep 25 01:10:04.851043 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 458/927] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:04 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:05.874665 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:05.875297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:05.882293 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.882771 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.883234 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:05.883966 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:05.884456 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:05.884893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:06.053528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:06.063154 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e9d082a2-43f1-4a9d-bd8c-6a58e3ea43d3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1365 microversion: 2.1 time: 0.192656 Sep 25 01:10:06.063852 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 470/928] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:05 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:07.087305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:07.088636 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:07.095298 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.096046 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.096590 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.097295 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:07.097914 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:07.098342 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:07.267618 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:07.276341 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8a1cec8f-1f19-4450-961f-8560b6b3666b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1365 microversion: 2.1 time: 0.193628 Sep 25 01:10:07.277384 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 459/929] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:07 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1365 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:08.303362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:08.304059 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:08.320761 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:08.321408 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:08.322073 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:08.325911 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:08.326982 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:08.327192 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:08.496640 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:08.505365 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5ca3885d-6072-416a-85b2-7cfae0728f50 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1365 microversion: 2.1 time: 0.206272 Sep 25 01:10:08.506270 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 471/930] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:08 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1365 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:08.783746 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-217faf47-5cdd-4fc3-9c33-aa5dcf596b1d req-ebbe7735-9b70-4e23-bc51-20a619d74723 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8770505-4fb4-4ca4-a04e-dc81a0770a3f", "name": "network-vif-plugged", "status": "completed", "tag": "8932c24d-6a85-44cf-a827-ce7a13d1d518"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:08.797615 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-217faf47-5cdd-4fc3-9c33-aa5dcf596b1d req-ebbe7735-9b70-4e23-bc51-20a619d74723 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:08.798855 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-217faf47-5cdd-4fc3-9c33-aa5dcf596b1d req-ebbe7735-9b70-4e23-bc51-20a619d74723 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:08.799302 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-217faf47-5cdd-4fc3-9c33-aa5dcf596b1d req-ebbe7735-9b70-4e23-bc51-20a619d74723 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:08.813512 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-217faf47-5cdd-4fc3-9c33-aa5dcf596b1d req-ebbe7735-9b70-4e23-bc51-20a619d74723 service nova] Creating event network-vif-plugged:8932c24d-6a85-44cf-a827-ce7a13d1d518 for instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f on hv-cinder-maste Sep 25 01:10:08.818638 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-217faf47-5cdd-4fc3-9c33-aa5dcf596b1d req-ebbe7735-9b70-4e23-bc51-20a619d74723 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040817 Sep 25 01:10:08.819370 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 460/931] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:09.530857 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:09.531676 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:09.539076 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.539866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.540521 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.541428 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:09.542564 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:09.543169 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:09.703412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:09.711787 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-76239782-55e7-4c33-8249-13be53274575 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1365 microversion: 2.1 time: 0.186617 Sep 25 01:10:09.712486 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 472/932] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:09 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1365 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:10.733579 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:10.734436 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:10.739805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:10.740551 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:10.748715 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.749244 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.749667 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.750466 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.750828 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.751287 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.911066 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:10.922531 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a0e9ba89-9a99-4985-bc04-8b09ee5f44f7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1555 microversion: 2.1 time: 0.190068 Sep 25 01:10:10.929844 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 461/933] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:10 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1555 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:10.954816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:10.955463 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:10.957687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=6 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:10.967135 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.967742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.968285 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:10.969195 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:10.969766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:10.970363 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:11.069398 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c10868b4-bb74-433a-9caf-b949dc40ca2d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.119067 Sep 25 01:10:11.069991 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 473/934] 10.222.0.26 () {58 vars in 1275 bytes} [Sun Sep 25 01:10:10 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-interface => generated 285 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:12.089531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-b0b9080f-cb90-440a-85c1-c8cb92954833 req-8a72d5ea-1d47-4ae7-959e-bb1173589f6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d8770505-4fb4-4ca4-a04e-dc81a0770a3f", "tag": "8932c24d-6a85-44cf-a827-ce7a13d1d518"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:12.101040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b0b9080f-cb90-440a-85c1-c8cb92954833 req-8a72d5ea-1d47-4ae7-959e-bb1173589f6c service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:12.101626 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b0b9080f-cb90-440a-85c1-c8cb92954833 req-8a72d5ea-1d47-4ae7-959e-bb1173589f6c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:12.101972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-b0b9080f-cb90-440a-85c1-c8cb92954833 req-8a72d5ea-1d47-4ae7-959e-bb1173589f6c service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:12.115832 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-b0b9080f-cb90-440a-85c1-c8cb92954833 req-8a72d5ea-1d47-4ae7-959e-bb1173589f6c service nova] Creating event network-changed:8932c24d-6a85-44cf-a827-ce7a13d1d518 for instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f on hv-cinder-maste Sep 25 01:10:12.122010 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-b0b9080f-cb90-440a-85c1-c8cb92954833 req-8a72d5ea-1d47-4ae7-959e-bb1173589f6c service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036187 Sep 25 01:10:12.122967 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 462/935] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:38.434179 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=40,nova_api:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:38.435254 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=72 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:38.439774 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-193254984", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "networks": [{"uuid": "326ede24-c984-4833-a0fe-f5f4ece4a688"}]}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:38.658802 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.network.neutron [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] validate_networks() for [('326ede24-c984-4833-a0fe-f5f4ece4a688', None, None, None, None, None)] {{(pid=120931) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:10:39.004240 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Flavor limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:10:39.004742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Image limits 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:10:39.005229 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Flavor pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:10:39.005679 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Image pref 0:0:0 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:10:39.006101 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.virt.hardware [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120931) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:10:39.015545 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:39.016036 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:39.016516 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:39.017263 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:39.017730 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:39.018166 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:39.037151 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Getting quotas for project 18a552c30f85444b88e70aad53c40058. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:10:39.041756 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Getting quotas for user 828083ee56c440d5a3e659021d2104b0 and project 18a552c30f85444b88e70aad53c40058. Resources: {'instances', 'cores', 'ram'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:10:39.054883 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Going to run 1 instances... {{(pid=120931) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:10:39.057959 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120931) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:10:39.103687 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-efb7de8d-3a38-417b-939e-a8dcd53f12e5 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.670782 Sep 25 01:10:39.104315 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 474/936] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:10:39.113193 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=37,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:39.113920 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=75 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:39.118602 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-41571caf-9d84-4c5c-936c-88d61a168949 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:39.119506 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-41571caf-9d84-4c5c-936c-88d61a168949 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:39.246367 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-41571caf-9d84-4c5c-936c-88d61a168949 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:39.253250 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-41571caf-9d84-4c5c-936c-88d61a168949 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1213 microversion: 2.1 time: 0.141711 Sep 25 01:10:39.253817 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 463/937] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:39 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1213 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:40.276440 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:40.277161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:40.290014 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:40.290652 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:40.291094 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:40.291800 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:40.292251 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:40.292717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:40.373057 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:40.380895 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-4b4d38c6-0162-44df-960a-047f4f5d899c tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1273 microversion: 2.1 time: 0.108998 Sep 25 01:10:40.392405 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 475/938] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:40 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1273 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:41.406691 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:41.407507 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:41.417925 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:41.418430 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:41.418875 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.419596 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:41.420054 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:41.420512 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.654774 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:41.663028 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-7782553b-ca97-4949-b8ba-9086761015c2 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.260337 Sep 25 01:10:41.663603 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 464/939] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:41 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:41.795240 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-4dbf6b2a-8c34-49ce-b0cf-897917412b4d req-40d03afb-e0f8-485c-b042-23276b4e1a5e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d9c0af9-5717-42af-b325-6365df1cd280", "tag": "e5f6a56f-af39-4e5b-9601-139e7f4819dd"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:41.806637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4dbf6b2a-8c34-49ce-b0cf-897917412b4d req-40d03afb-e0f8-485c-b042-23276b4e1a5e service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:41.807745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4dbf6b2a-8c34-49ce-b0cf-897917412b4d req-40d03afb-e0f8-485c-b042-23276b4e1a5e service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:41.808202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4dbf6b2a-8c34-49ce-b0cf-897917412b4d req-40d03afb-e0f8-485c-b042-23276b4e1a5e service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:41.820567 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-4dbf6b2a-8c34-49ce-b0cf-897917412b4d req-40d03afb-e0f8-485c-b042-23276b4e1a5e service nova] Creating event network-changed:e5f6a56f-af39-4e5b-9601-139e7f4819dd for instance 0d9c0af9-5717-42af-b325-6365df1cd280 on hv-cinder-maste Sep 25 01:10:41.826587 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-4dbf6b2a-8c34-49ce-b0cf-897917412b4d req-40d03afb-e0f8-485c-b042-23276b4e1a5e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035347 Sep 25 01:10:41.827187 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 476/940] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:42.687390 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:42.688015 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:42.694543 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:42.695036 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:42.695478 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:42.696190 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:42.696672 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:42.697104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:42.846132 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:42.856457 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e32c7856-561f-4cc1-99f8-fbe714cdf259 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.173588 Sep 25 01:10:42.857407 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 465/941] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:42 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:43.881600 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:43.882603 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:43.889300 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:43.889791 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:43.890237 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:43.890937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:43.891399 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:43.891878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:44.033017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:44.041496 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5c15c6cf-bc59-476a-ab99-b27bb61800ea tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.164673 Sep 25 01:10:44.042069 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 477/942] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:43 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:45.064587 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:45.065242 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:45.072398 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.072890 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.073413 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.074125 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:45.074575 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:45.075003 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:45.330597 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:45.339168 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0c131520-0d8c-416b-880d-67b9d48eb2c9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.278719 Sep 25 01:10:45.339854 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 466/943] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:45 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:46.363172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:46.363836 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:46.371374 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:46.371903 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:46.372349 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:46.373121 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:46.373558 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:46.373983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:46.512826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:46.521079 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f27019a2-9c48-41b8-9882-d5ac213ea003 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.162390 Sep 25 01:10:46.521693 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 478/944] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:46 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:47.545798 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:47.547037 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:47.553890 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.554394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.554850 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.555572 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:47.556227 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:47.556699 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:47.707130 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:47.715483 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d4e61c55-e06f-497e-a38f-2a00d362c360 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.173527 Sep 25 01:10:47.716154 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 467/945] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:47 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:48.738697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:48.739315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:48.745803 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:48.746321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:48.746734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:48.747438 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:48.747892 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:48.748321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:48.879468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:48.887925 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e0332d71-1f81-4a1b-8a5c-ce578c9d5bf7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.153074 Sep 25 01:10:48.888617 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 479/946] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:48 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:49.029198 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-3e5271e7-45ed-452b-9525-76c6289b03cb req-f18adc95-c7b1-43f0-a3ef-32cb1be366c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9c0af9-5717-42af-b325-6365df1cd280", "name": "network-vif-plugged", "status": "completed", "tag": "e5f6a56f-af39-4e5b-9601-139e7f4819dd"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:49.040705 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3e5271e7-45ed-452b-9525-76c6289b03cb req-f18adc95-c7b1-43f0-a3ef-32cb1be366c9 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.041987 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3e5271e7-45ed-452b-9525-76c6289b03cb req-f18adc95-c7b1-43f0-a3ef-32cb1be366c9 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.042518 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-3e5271e7-45ed-452b-9525-76c6289b03cb req-f18adc95-c7b1-43f0-a3ef-32cb1be366c9 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.054598 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-3e5271e7-45ed-452b-9525-76c6289b03cb req-f18adc95-c7b1-43f0-a3ef-32cb1be366c9 service nova] Creating event network-vif-plugged:e5f6a56f-af39-4e5b-9601-139e7f4819dd for instance 0d9c0af9-5717-42af-b325-6365df1cd280 on hv-cinder-maste Sep 25 01:10:49.060199 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-3e5271e7-45ed-452b-9525-76c6289b03cb req-f18adc95-c7b1-43f0-a3ef-32cb1be366c9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034660 Sep 25 01:10:49.061171 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 468/947] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:49.911401 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:49.912256 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:49.914835 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:49.915517 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=6 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:49.922179 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.922672 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.923113 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:49.923818 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:49.924277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:49.924732 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:50.057044 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:50.065112 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1e3f4b14-59c2-448a-ba4b-a7ead7a535f8 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.157753 Sep 25 01:10:50.065691 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 480/948] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:49 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:51.088116 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:51.088857 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:51.091367 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:10:51.098132 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.098628 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.099075 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.099800 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:51.100264 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:51.100834 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:51.242088 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:51.251096 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-43e65c3d-97f8-4732-b36a-e5b9b9ed64ad tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1313 microversion: 2.1 time: 0.167535 Sep 25 01:10:51.251778 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 469/949] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:51 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1313 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:52.274519 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:52.275147 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:52.281850 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.282344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.282791 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.283514 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.283974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.284427 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.437884 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:52.446501 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6e3be7ff-ca1a-403f-94eb-013cb755a7e3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1496 microversion: 2.1 time: 0.175990 Sep 25 01:10:52.447090 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 481/950] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:52 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1496 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:52.897654 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:52.898213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:52.904762 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.905252 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.905689 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.906388 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:52.906845 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:52.907389 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:52.936238 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:53.018610 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-22186f45-35f2-4a6f-b863-6ad0c2f2cee9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "DELETE /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 204 len: 0 microversion: 2.1 time: 0.124569 Sep 25 01:10:53.019275 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 470/951] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:10:52 2022] DELETE /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:10:53.027798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:53.028472 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:53.034551 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:53.035039 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:53.035486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.036187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:53.036929 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:53.037381 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:53.171478 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:53.179228 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-447ef0b5-e94d-4f37-8bfb-208b6dd651f3 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1502 microversion: 2.1 time: 0.155399 Sep 25 01:10:53.179798 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 482/952] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:53 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1502 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:54.202483 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:54.203239 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:54.209756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.210236 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.210678 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.212013 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:54.212508 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:54.212942 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:54.346607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:54.354403 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0541d931-d3d0-4ce3-a2ea-68b730701663 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1502 microversion: 2.1 time: 0.156472 Sep 25 01:10:54.354983 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 471/953] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:54 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:55.153798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-6d365aaa-6d2b-459e-8d34-4a01efbdc1fb req-4b274690-a5e6-44f5-9eeb-45a2a76098a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d9c0af9-5717-42af-b325-6365df1cd280", "name": "network-vif-deleted", "tag": "e5f6a56f-af39-4e5b-9601-139e7f4819dd"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:55.165972 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6d365aaa-6d2b-459e-8d34-4a01efbdc1fb req-4b274690-a5e6-44f5-9eeb-45a2a76098a0 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.166700 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6d365aaa-6d2b-459e-8d34-4a01efbdc1fb req-4b274690-a5e6-44f5-9eeb-45a2a76098a0 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.167172 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6d365aaa-6d2b-459e-8d34-4a01efbdc1fb req-4b274690-a5e6-44f5-9eeb-45a2a76098a0 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.179173 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-6d365aaa-6d2b-459e-8d34-4a01efbdc1fb req-4b274690-a5e6-44f5-9eeb-45a2a76098a0 service nova] Creating event network-vif-deleted:e5f6a56f-af39-4e5b-9601-139e7f4819dd for instance 0d9c0af9-5717-42af-b325-6365df1cd280 on hv-cinder-maste Sep 25 01:10:55.185295 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-6d365aaa-6d2b-459e-8d34-4a01efbdc1fb req-4b274690-a5e6-44f5-9eeb-45a2a76098a0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035218 Sep 25 01:10:55.185955 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 483/954] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:10:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:10:55.377509 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:55.378219 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:55.384985 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.385476 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.385916 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.386620 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.387078 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.387503 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.422595 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:55.423082 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:55.423528 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:55.423980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lazy-loading 'fault' on Instance uuid 0d9c0af9-5717-42af-b325-6365df1cd280 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:10:55.465442 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:55.474466 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8525ef61-3259-4fb1-a0c9-54c183ca21fe tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 200 len: 1303 microversion: 2.1 time: 0.100990 Sep 25 01:10:55.475126 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 472/955] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:55 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 1303 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:56.500161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:56.500886 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: 0d9c0af9-5717-42af-b325-6365df1cd280] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:56.507117 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.507596 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.508035 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.508922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:56.509374 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:56.509795 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:56.523010 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] HTTP exception thrown: Instance 0d9c0af9-5717-42af-b325-6365df1cd280 could not be found. Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Request method failure captured: Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 HTTP/1.1 Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6qM2Q81eegIJJuvVD3wqs8CLBryaWB2YVOTZg9oQcdKT8AgcH2d0SCScVgPOw0XR7novsbeH1PJPPtxoGJhMVA5s5yNP7XzLkPQ5Ivjs77263SzkOxub632Y0WQJDsmZlezRE7uUrpdldMV2EqmK4l6ablOBKGuvPwI67IWysK4H0I Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 18a552c30f85444b88e70aad53c40058 Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-VolumesActionsTest-789942184 Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:10:56.524680 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18a552c30f85444b88e70aad53c40058", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18a552c30f85444b88e70aad53c40058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18a552c30f85444b88e70aad53c40058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18a552c30f85444b88e70aad53c40058"}]}] Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-VolumesActionsTest-789942184 Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 18a552c30f85444b88e70aad53c40058 Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-VolumesActionsTest-789942184 Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-VolumesActionsTest-789942184-project Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 828083ee56c440d5a3e659021d2104b0 Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-VolumesActionsTest-789942184-project Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 0d9c0af9-5717-42af-b325-6365df1cd280 could not be found. Sep 25 01:10:56.526392 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '0d9c0af9-5717-42af-b325-6365df1cd280'} Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0d9c0af9-5717-42af-b325-6365df1cd280 could not be found. Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:10:56.527450 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0d9c0af9-5717-42af-b325-6365df1cd280 could not be found. Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0d9c0af9-5717-42af-b325-6365df1cd280 could not be found. Sep 25 01:10:56.528995 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:10:56.530420 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Returning 404 to user: Instance 0d9c0af9-5717-42af-b325-6365df1cd280 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:10:56.530420 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1326b06c-2908-49bd-a1b6-f67149b36535 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280" status: 404 len: 111 microversion: 2.1 time: 0.030620 Sep 25 01:10:56.530420 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 484/956] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:56 2022] GET /compute/v2.1/servers/0d9c0af9-5717-42af-b325-6365df1cd280 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:10:56.633391 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-2051548098", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452", "networks": [{"uuid": "326ede24-c984-4833-a0fe-f5f4ece4a688"}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:10:56.689080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] validate_networks() for [('326ede24-c984-4833-a0fe-f5f4ece4a688', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:10:57.293593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:10:57.293593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:10:57.294005 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:10:57.294441 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:10:57.294859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:10:57.304213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.304213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.304650 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.305605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:57.306065 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:57.306623 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:57.324338 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Getting quotas for project 18a552c30f85444b88e70aad53c40058. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:10:57.328557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Getting quotas for user 828083ee56c440d5a3e659021d2104b0 and project 18a552c30f85444b88e70aad53c40058. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:10:57.340769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:10:57.343154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:10:57.389845 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-06dd3b83-4733-4fba-ade2-4548e45d7559 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.762016 Sep 25 01:10:57.390509 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 473/957] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:10:56 2022] POST /compute/v2.1/servers => generated 380 bytes in 764 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:10:57.402263 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-29997fe2-7658-4366-a57c-eca2b57deaef tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:57.402880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-29997fe2-7658-4366-a57c-eca2b57deaef tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:57.461910 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-29997fe2-7658-4366-a57c-eca2b57deaef tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:57.469404 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-29997fe2-7658-4366-a57c-eca2b57deaef tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1214 microversion: 2.1 time: 0.071621 Sep 25 01:10:57.470014 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 485/958] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:57 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1214 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:10:58.491903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:58.492612 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:58.500065 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.500593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.501042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.501752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:58.502213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:58.502647 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:58.582489 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:58.591793 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1fb03d09-000b-41c2-848d-44b81ea17508 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1266 microversion: 2.1 time: 0.104331 Sep 25 01:10:58.599446 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 474/959] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:58 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1266 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:59.554099 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.556785 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.565063 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.565554 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.565998 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.566710 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.567170 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.567597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.598667 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0b3d2a18-f782-4bca-bd80-9cb9fb05e387 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048553 Sep 25 01:10:59.599248 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 486/960] 10.222.0.26 () {60 vars in 1343 bytes} [Sun Sep 25 01:10:59 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f/os-volume_attachments => generated 25 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:59.617868 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.618494 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.625229 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.625720 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.626268 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.626865 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.627321 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.627754 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.666309 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.666790 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.672786 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.673282 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.673727 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.674493 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.675130 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.675723 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.703490 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:10:59.791465 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ebca4d19-bedb-49b0-b282-69a5da43e551 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 204 len: 0 microversion: 2.20 time: 0.128724 Sep 25 01:10:59.792284 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 487/961] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Sep 25 01:10:59 2022] DELETE /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 0 bytes in 131 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:10:59.801352 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:10:59.802058 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:10:59.808956 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.809441 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.809878 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.810587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:10:59.811027 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:10:59.811451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:10:59.870479 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.880122 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ab58dcea-2308-44a0-829d-8a0eb9d035b7 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.267334 Sep 25 01:10:59.880748 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 475/962] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:10:59 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:10:59.962364 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.970827 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.972272 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:10:59.973574 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b576e815-0a40-4c5a-83cd-6deee50f6d02 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.176554 Sep 25 01:10:59.974148 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 488/963] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:10:59 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:11:00.073531 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-772680b9-e485-467a-a03e-e76e1d2eabdc req-e947682a-b7d2-4e0c-b2cc-8265cf8cc24f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c30053b2-666b-4773-93cd-c650b7fa5836", "tag": "e5c06330-35c3-4de0-bad6-261a0729b289"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:00.083173 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-772680b9-e485-467a-a03e-e76e1d2eabdc req-e947682a-b7d2-4e0c-b2cc-8265cf8cc24f service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.083660 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-772680b9-e485-467a-a03e-e76e1d2eabdc req-e947682a-b7d2-4e0c-b2cc-8265cf8cc24f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.084098 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-772680b9-e485-467a-a03e-e76e1d2eabdc req-e947682a-b7d2-4e0c-b2cc-8265cf8cc24f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.095675 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-772680b9-e485-467a-a03e-e76e1d2eabdc req-e947682a-b7d2-4e0c-b2cc-8265cf8cc24f service nova] Creating event network-changed:e5c06330-35c3-4de0-bad6-261a0729b289 for instance c30053b2-666b-4773-93cd-c650b7fa5836 on hv-cinder-maste Sep 25 01:11:00.100549 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-772680b9-e485-467a-a03e-e76e1d2eabdc req-e947682a-b7d2-4e0c-b2cc-8265cf8cc24f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031759 Sep 25 01:11:00.101196 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 476/964] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:00.904363 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:00.905029 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:00.911748 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.912227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.912692 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:00.913388 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:00.913838 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:00.914821 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.002516 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:01.003795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:01.014933 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.015704 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.016429 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.017398 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:01.018059 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:01.018685 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:01.055706 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.064308 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b3fdd097-77dd-4153-a2ee-327a220f079d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.163701 Sep 25 01:11:01.065029 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 489/965] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:00 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:01.239406 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.248973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.250428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:01.251608 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-b97f3abd-0a11-4adf-a9b3-3791130b2aa1 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.255797 Sep 25 01:11:01.252435 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 477/966] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:00 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 25 01:11:02.089836 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:02.090398 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:02.096468 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.096966 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.097415 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.098127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.098612 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.099040 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.237074 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:02.245379 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3a1a7a60-c5d0-4385-a318-f3e205297ac6 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.160151 Sep 25 01:11:02.245992 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 490/967] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:02 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:02.276850 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:02.277535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:02.284028 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.284579 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.285022 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.285738 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.286191 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.286876 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.527181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:02.536095 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:02.537863 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:02.539554 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-16f58522-e2c5-4fe3-9cd9-c30d61c0ce6c tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1721 microversion: 2.20 time: 0.266302 Sep 25 01:11:02.540356 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 478/968] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:02 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:02.925248 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-4d27e142-b434-4e30-a822-1be6615e633f req-92df4819-5098-44b5-b1f5-173a4ffde51a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "860527d0-4a7d-421f-8326-1d565c5f9f8f", "name": "network-vif-deleted", "tag": "47b9f80d-5f51-4b6e-ba3a-7dc7fe295721"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:02.935076 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4d27e142-b434-4e30-a822-1be6615e633f req-92df4819-5098-44b5-b1f5-173a4ffde51a service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:02.935557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4d27e142-b434-4e30-a822-1be6615e633f req-92df4819-5098-44b5-b1f5-173a4ffde51a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:02.935993 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-4d27e142-b434-4e30-a822-1be6615e633f req-92df4819-5098-44b5-b1f5-173a4ffde51a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:02.947966 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-4d27e142-b434-4e30-a822-1be6615e633f req-92df4819-5098-44b5-b1f5-173a4ffde51a service nova] Creating event network-vif-deleted:47b9f80d-5f51-4b6e-ba3a-7dc7fe295721 for instance 860527d0-4a7d-421f-8326-1d565c5f9f8f on hv-cinder-maste Sep 25 01:11:02.952857 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-4d27e142-b434-4e30-a822-1be6615e633f req-92df4819-5098-44b5-b1f5-173a4ffde51a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031328 Sep 25 01:11:02.953448 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 491/969] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:03.268926 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:03.269551 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:03.275783 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.276281 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.276747 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.277455 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.278000 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.278324 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.425755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.434739 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5773f0f5-4d79-4501-9717-cc9db903ba89 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.169657 Sep 25 01:11:03.435331 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 479/970] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:03 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:03.568291 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:03.569127 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:03.575753 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.576343 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.576816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.577581 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:03.577975 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:03.578414 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:03.647784 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.657104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.658548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:03.659726 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-a4457011-c1c7-42f1-808e-a2909a71ccb3 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1654 microversion: 2.20 time: 0.096284 Sep 25 01:11:03.660289 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 492/971] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:03 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1654 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:04.458236 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:04.458859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:04.466593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.467090 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.467671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.468407 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.468887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.469318 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.490818 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:04.622063 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.630973 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-32ce4abf-a7ca-410f-b7b4-55268c3d8236 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.177161 Sep 25 01:11:04.631551 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 480/972] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:04 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:04.686522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:04.687171 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:04.693447 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.693936 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.694382 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.695745 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.696291 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.696769 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.701249 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:04.732705 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:04.733191 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:04.733627 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:04.734071 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lazy-loading 'fault' on Instance uuid 860527d0-4a7d-421f-8326-1d565c5f9f8f {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:04.775368 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.783489 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.784980 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'c468aa6d1248478286fe0a8792411a91', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'cc51ee9f630a4bc89f1fccbd7ff20c51', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:04.786196 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0361f916-c9c3-41fa-8146-a3225244b56a tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 200 len: 1371 microversion: 2.20 time: 0.103616 Sep 25 01:11:04.787007 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 493/973] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:04 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 25 01:11:05.654894 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:05.655507 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:05.662556 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:05.663085 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:05.663562 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:05.664308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:05.664797 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:05.665226 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:05.794423 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:05.802247 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f8d52936-5cf0-4980-8c9b-4a62cbf60c31 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.151573 Sep 25 01:11:05.802826 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 481/974] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:05 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:05.811742 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:05.812478 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:05.819198 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:05.819687 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:05.820781 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:05.821495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:05.821953 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:05.822384 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:05.836947 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] HTTP exception thrown: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Request method failure captured: Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f HTTP/1.1 Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hLXqjQc5Z7fgX4Yzky7HVBWL_H1z9hNL0B3utZid7fGPqyRLBCeAbBqP8J0u0BYdLJIKD9w5i62_jK3EY0sbzaTCQ-nzMCBqhVXQp5FbCNC5KaokVDqUxtmw-NqMYY8SsmAkAWsp9l0ZzKO85Qg52c-1P63g8mSZ0qZqHf8TU4tWY Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:05.838622 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc51ee9f630a4bc89f1fccbd7ff20c51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}] Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: c468aa6d1248478286fe0a8792411a91 Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:05.840299 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '860527d0-4a7d-421f-8326-1d565c5f9f8f'} Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:05.841259 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:05.842792 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:05.844151 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Returning 404 to user: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:05.844151 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1a8edf67-b6fc-4e23-8d0e-177325d83246 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 404 len: 111 microversion: 2.20 time: 0.032258 Sep 25 01:11:05.844151 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 494/975] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:05 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:05.849213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1ad9fc45-3efb-465e-9c4b-05637f62ba39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '.version_select at 0x7f118140e1f0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:05.868892 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1ad9fc45-3efb-465e-9c4b-05637f62ba39 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-630057825" status: 204 len: 0 microversion: 2.20 time: 0.023502 Sep 25 01:11:05.869468 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 482/976] 10.222.0.26 () {60 vars in 1259 bytes} [Sun Sep 25 01:11:05 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-630057825 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 25 01:11:06.825185 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:06.825786 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:06.832271 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.832798 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.833227 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.833936 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:06.834402 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:06.834821 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:06.975731 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:06.983898 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-155fe6ca-af51-4751-87e0-1a6e26a7c1b9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.162544 Sep 25 01:11:06.984577 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 495/977] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:06 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:07.664889 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:07.666325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:07.671867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:07.672403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:07.680844 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.681337 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.681781 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.682491 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.682942 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.683363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.699329 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] HTTP exception thrown: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Request method failure captured: Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f HTTP/1.1 Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hLXqjQc5Z7fgX4Yzky7HVBWL_H1z9hNL0B3utZid7fGPqyRLBCeAbBqP8J0u0BYdLJIKD9w5i62_jK3EY0sbzaTCQ-nzMCBqhVXQp5FbCNC5KaokVDqUxtmw-NqMYY8SsmAkAWsp9l0ZzKO85Qg52c-1P63g8mSZ0qZqHf8TU4tWY Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:07.701072 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc51ee9f630a4bc89f1fccbd7ff20c51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}] Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: c468aa6d1248478286fe0a8792411a91 Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.702732 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '860527d0-4a7d-421f-8326-1d565c5f9f8f'} Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:07.703618 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.705266 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.706773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Returning 404 to user: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:07.706773 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-992d9e90-8445-459c-80bd-4df800e19a7d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 404 len: 111 microversion: 2.20 time: 0.039398 Sep 25 01:11:07.706773 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 483/978] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Sep 25 01:11:07 2022] DELETE /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 25 01:11:07.711810 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:07.712586 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: 860527d0-4a7d-421f-8326-1d565c5f9f8f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:07.714379 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:07.719734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.720223 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.720696 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.721403 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:07.721861 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:07.722291 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:07.735632 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] HTTP exception thrown: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Request method failure captured: Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f HTTP/1.1 Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hLXqjQc5Z7fgX4Yzky7HVBWL_H1z9hNL0B3utZid7fGPqyRLBCeAbBqP8J0u0BYdLJIKD9w5i62_jK3EY0sbzaTCQ-nzMCBqhVXQp5FbCNC5KaokVDqUxtmw-NqMYY8SsmAkAWsp9l0ZzKO85Qg52c-1P63g8mSZ0qZqHf8TU4tWY Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:07.737205 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc51ee9f630a4bc89f1fccbd7ff20c51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}] Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: c468aa6d1248478286fe0a8792411a91 Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.738930 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '860527d0-4a7d-421f-8326-1d565c5f9f8f'} Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:07.740013 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. Sep 25 01:11:07.741636 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:07.743070 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Returning 404 to user: Instance 860527d0-4a7d-421f-8326-1d565c5f9f8f could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:07.743070 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f605129f-fa18-4f30-8810-cc574716f68e tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f" status: 404 len: 111 microversion: 2.20 time: 0.031422 Sep 25 01:11:07.743070 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 496/979] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:07 2022] GET /compute/v2.1/servers/860527d0-4a7d-421f-8326-1d565c5f9f8f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:08.008305 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:08.008954 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:08.014929 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.015421 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.015861 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.016592 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.017056 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.017488 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.413418 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:08.421210 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3a6ea72d-2cb9-41a1-9116-e0d64da89d44 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.417650 Sep 25 01:11:08.421821 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 484/980] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:08 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:08.891618 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:08.892129 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:08.894413 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:08.900207 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.900717 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.901150 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.901849 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.902407 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.902722 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.919646 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] HTTP exception thrown: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Request method failure captured: Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: DELETE /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 HTTP/1.1 Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6hLXqjQc5Z7fgX4Yzky7HVBWL_H1z9hNL0B3utZid7fGPqyRLBCeAbBqP8J0u0BYdLJIKD9w5i62_jK3EY0sbzaTCQ-nzMCBqhVXQp5FbCNC5KaokVDqUxtmw-NqMYY8SsmAkAWsp9l0ZzKO85Qg52c-1P63g8mSZ0qZqHf8TU4tWY Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:08.921332 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc51ee9f630a4bc89f1fccbd7ff20c51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}] Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: c468aa6d1248478286fe0a8792411a91 Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.923058 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': 'e3594bb0-3667-44b5-badd-3dcfe8b74c27'} Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:08.924076 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.925580 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.927251 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Returning 404 to user: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:08.927251 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-08096e65-8384-4393-87c9-2aa76575dfe7 tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "DELETE /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 404 len: 111 microversion: 2.20 time: 0.035061 Sep 25 01:11:08.927251 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 497/981] 10.222.0.26 () {60 vars in 1280 bytes} [Sun Sep 25 01:11:08 2022] DELETE /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:08.932593 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:08.933214 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] [instance: e3594bb0-3667-44b5-badd-3dcfe8b74c27] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:08.939649 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.940133 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.940604 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.941298 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:08.941752 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:08.942178 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:08.955538 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] HTTP exception thrown: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Request method failure captured: Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 HTTP/1.1 Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6hLXqjQc5Z7fgX4Yzky7HVBWL_H1z9hNL0B3utZid7fGPqyRLBCeAbBqP8J0u0BYdLJIKD9w5i62_jK3EY0sbzaTCQ-nzMCBqhVXQp5FbCNC5KaokVDqUxtmw-NqMYY8SsmAkAWsp9l0ZzKO85Qg52c-1P63g8mSZ0qZqHf8TU4tWY Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Openstack-Nova-Api-Version: 2.20 Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:08.957105 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_cc51ee9f630a4bc89f1fccbd7ff20c51", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/cc51ee9f630a4bc89f1fccbd7ff20c51"}]}] Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: cc51ee9f630a4bc89f1fccbd7ff20c51 Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1641006735 Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: c468aa6d1248478286fe0a8792411a91 Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1641006735-project Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.958751 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'e3594bb0-3667-44b5-badd-3dcfe8b74c27'} Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:08.959582 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. Sep 25 01:11:08.961394 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:08.962500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] Returning 404 to user: Instance e3594bb0-3667-44b5-badd-3dcfe8b74c27 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:08.962500 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-63a19126-1dae-4294-92d8-2adb4127cb9d tempest-AttachVolumeShelveTestJSON-1641006735 tempest-AttachVolumeShelveTestJSON-1641006735-project] 10.222.0.26 "GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27" status: 404 len: 111 microversion: 2.20 time: 0.029876 Sep 25 01:11:08.962500 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 485/982] 10.222.0.26 () {60 vars in 1277 bytes} [Sun Sep 25 01:11:08 2022] GET /compute/v2.1/servers/e3594bb0-3667-44b5-badd-3dcfe8b74c27 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 25 01:11:09.140001 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-2f48bf1c-7f0d-4be9-b316-b42977f38da6 req-5a6549e8-0521-4b37-9176-1822ac452052 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30053b2-666b-4773-93cd-c650b7fa5836", "name": "network-vif-plugged", "status": "completed", "tag": "e5c06330-35c3-4de0-bad6-261a0729b289"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:09.151216 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-2f48bf1c-7f0d-4be9-b316-b42977f38da6 req-5a6549e8-0521-4b37-9176-1822ac452052 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.151712 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-2f48bf1c-7f0d-4be9-b316-b42977f38da6 req-5a6549e8-0521-4b37-9176-1822ac452052 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.152162 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-2f48bf1c-7f0d-4be9-b316-b42977f38da6 req-5a6549e8-0521-4b37-9176-1822ac452052 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.165206 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-2f48bf1c-7f0d-4be9-b316-b42977f38da6 req-5a6549e8-0521-4b37-9176-1822ac452052 service nova] Creating event network-vif-plugged:e5c06330-35c3-4de0-bad6-261a0729b289 for instance c30053b2-666b-4773-93cd-c650b7fa5836 on hv-cinder-maste Sep 25 01:11:09.170568 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-2f48bf1c-7f0d-4be9-b316-b42977f38da6 req-5a6549e8-0521-4b37-9176-1822ac452052 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034300 Sep 25 01:11:09.171335 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 498/983] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:09.444549 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:09.445862 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:09.448036 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:09.454758 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.455259 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.455895 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.456657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:09.457335 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:09.457771 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:09.613341 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:09.622761 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cc0894e3-7d9d-455c-8fb9-2578618f2a5e tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.182058 Sep 25 01:11:09.623465 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 486/984] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:09 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:10.647623 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:10.648333 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:10.654864 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.655404 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.655880 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.656637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:10.657101 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:10.657702 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:10.890923 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:10.899291 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-32674a88-2a24-4e5a-92dd-65f0c3c8c481 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1314 microversion: 2.1 time: 0.256570 Sep 25 01:11:10.899874 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 499/985] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:10 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1314 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:11.928521 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:11.929652 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:11.936591 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.937099 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.937547 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:11.938343 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:11.938873 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:11.939373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.160769 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:12.170146 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ac5d0117-6b2b-49cb-9f47-1ed576c3f3ff tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1497 microversion: 2.1 time: 0.250453 Sep 25 01:11:12.170895 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 487/986] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:11 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1497 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:12.859620 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:12.860287 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:12.866829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.867331 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.867796 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.868855 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:12.869460 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:12.869893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:12.899124 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:12.990279 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-f458fd61-9e33-4dc5-be09-a5de41694eb9 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "DELETE /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 204 len: 0 microversion: 2.1 time: 0.134270 Sep 25 01:11:12.994942 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 500/987] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:12 2022] DELETE /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:11:13.000607 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:13.001404 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:13.010222 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.010627 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.011079 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.011805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:13.012278 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:13.012742 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:13.174141 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:13.182296 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5002d04f-810e-4c73-b876-2987f06e41e0 tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1503 microversion: 2.1 time: 0.186077 Sep 25 01:11:13.182877 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 488/988] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:12 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1503 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:14.206208 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:14.207068 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:14.215046 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.215885 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.216613 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.217840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:14.218653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:14.219456 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:14.331791 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0bfddfff-f40a-41a1-866d-b77a080294e3 tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Action: 'create', calling method: .version_select at 0x7f11815078b0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-881498263", "metadata": {"Type": "work"}}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:14.395557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:14.426998 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-c32bcd60-679c-4959-b6c4-0df552122ddb tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1503 microversion: 2.1 time: 0.224479 Sep 25 01:11:14.427634 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 489/989] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:14 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1503 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:11:14.694240 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0bfddfff-f40a-41a1-866d-b77a080294e3 tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] 10.222.0.26 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.505193 Sep 25 01:11:14.695570 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 501/990] 10.222.0.26 () {60 vars in 1156 bytes} [Sun Sep 25 01:11:14 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 507 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 25 01:11:14.709373 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-53e9ed37-7464-4184-bb56-108ee1740fed tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Calling method '.version_select at 0x7f118140e4c0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:14.763182 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-53e9ed37-7464-4184-bb56-108ee1740fed tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba" status: 200 len: 352 microversion: 2.1 time: 0.057966 Sep 25 01:11:14.763913 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 490/991] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:11:14 2022] GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:15.297339 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-6881b7f5-22f6-4272-96a5-074494406df9 req-430acc3c-ade4-4813-808b-b8aa446fc136 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c30053b2-666b-4773-93cd-c650b7fa5836", "name": "network-vif-deleted", "tag": "e5c06330-35c3-4de0-bad6-261a0729b289"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:15.309111 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6881b7f5-22f6-4272-96a5-074494406df9 req-430acc3c-ade4-4813-808b-b8aa446fc136 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.309595 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6881b7f5-22f6-4272-96a5-074494406df9 req-430acc3c-ade4-4813-808b-b8aa446fc136 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.310633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-6881b7f5-22f6-4272-96a5-074494406df9 req-430acc3c-ade4-4813-808b-b8aa446fc136 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.324151 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-6881b7f5-22f6-4272-96a5-074494406df9 req-430acc3c-ade4-4813-808b-b8aa446fc136 service nova] Creating event network-vif-deleted:e5c06330-35c3-4de0-bad6-261a0729b289 for instance c30053b2-666b-4773-93cd-c650b7fa5836 on hv-cinder-maste Sep 25 01:11:15.331443 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-6881b7f5-22f6-4272-96a5-074494406df9 req-430acc3c-ade4-4813-808b-b8aa446fc136 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037946 Sep 25 01:11:15.332356 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 502/992] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:15.460136 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:15.460741 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:15.468031 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.468577 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.469054 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.469833 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.470320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.470760 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.508903 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:15.509409 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:15.509860 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:15.510323 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.objects.instance [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lazy-loading 'fault' on Instance uuid c30053b2-666b-4773-93cd-c650b7fa5836 {{(pid=120932) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:15.562933 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '828083ee56c440d5a3e659021d2104b0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '18a552c30f85444b88e70aad53c40058', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:15.571325 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1c263c30-abc3-4806-a795-a45208704b6d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 200 len: 1304 microversion: 2.1 time: 0.115618 Sep 25 01:11:15.572188 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 491/993] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:15 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 1304 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:15.779421 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5ff9b0d2-8488-4b2f-a207-0d5364f3d5f5 tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Calling method '.version_select at 0x7f1181507ca0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:15.830535 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5ff9b0d2-8488-4b2f-a207-0d5364f3d5f5 tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba" status: 200 len: 353 microversion: 2.1 time: 0.055396 Sep 25 01:11:15.831115 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 503/994] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:11:15 2022] GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:15.843979 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0b67f2dd-193f-42e1-b8d5-0e847952f04c tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Calling method '.version_select at 0x7f11817df430>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:15.897774 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0b67f2dd-193f-42e1-b8d5-0e847952f04c tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba" status: 200 len: 353 microversion: 2.1 time: 0.057527 Sep 25 01:11:15.903017 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 492/995] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:11:15 2022] GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba => generated 353 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:15.916588 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-0862de00-401e-4fa8-bb09-fbe5edf22dce tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Calling method '.version_select at 0x7f11815363a0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:15.982492 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-0862de00-401e-4fa8-bb09-fbe5edf22dce tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] 10.222.0.26 "DELETE /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba" status: 202 len: 0 microversion: 2.1 time: 0.069530 Sep 25 01:11:15.983244 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 504/996] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:11:15 2022] DELETE /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:11:15.993882 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3aa682bb-7476-4632-b2c5-588b777a3246 tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Calling method '.version_select at 0x7f11815c79d0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:16.045899 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3aa682bb-7476-4632-b2c5-588b777a3246 tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba" status: 200 len: 352 microversion: 2.1 time: 0.057456 Sep 25 01:11:16.046781 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 493/997] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:11:15 2022] GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba => generated 352 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:11:16.595996 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:16.596891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] [instance: c30053b2-666b-4773-93cd-c650b7fa5836] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:16.604888 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:16.605384 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:16.605829 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:16.606983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:16.607122 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:16.607480 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:16.622930 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] HTTP exception thrown: Instance c30053b2-666b-4773-93cd-c650b7fa5836 could not be found. Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Request method failure captured: Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 HTTP/1.1 Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6qM2Q81eegIJJuvVD3wqs8CLBryaWB2YVOTZg9oQcdKT8AgcH2d0SCScVgPOw0XR7novsbeH1PJPPtxoGJhMVA5s5yNP7XzLkPQ5Ivjs77263SzkOxub632Y0WQJDsmZlezRE7uUrpdldMV2EqmK4l6ablOBKGuvPwI67IWysK4H0I Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: 18a552c30f85444b88e70aad53c40058 Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-VolumesActionsTest-789942184 Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:16.624666 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_18a552c30f85444b88e70aad53c40058", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/18a552c30f85444b88e70aad53c40058"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18a552c30f85444b88e70aad53c40058"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/18a552c30f85444b88e70aad53c40058"}]}] Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-VolumesActionsTest-789942184 Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: 18a552c30f85444b88e70aad53c40058 Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-VolumesActionsTest-789942184 Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-VolumesActionsTest-789942184-project Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 828083ee56c440d5a3e659021d2104b0 Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-VolumesActionsTest-789942184-project Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance c30053b2-666b-4773-93cd-c650b7fa5836 could not be found. Sep 25 01:11:16.626485 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': 'c30053b2-666b-4773-93cd-c650b7fa5836'} Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c30053b2-666b-4773-93cd-c650b7fa5836 could not be found. Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:16.627478 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c30053b2-666b-4773-93cd-c650b7fa5836 could not be found. Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c30053b2-666b-4773-93cd-c650b7fa5836 could not be found. Sep 25 01:11:16.629121 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:16.630538 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] Returning 404 to user: Instance c30053b2-666b-4773-93cd-c650b7fa5836 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:16.630538 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5b1808b7-87f8-4ae3-847d-57883234694d tempest-VolumesActionsTest-789942184 tempest-VolumesActionsTest-789942184-project] 10.222.0.26 "GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836" status: 404 len: 111 microversion: 2.1 time: 0.035244 Sep 25 01:11:16.630538 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 505/998] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:16 2022] GET /compute/v2.1/servers/c30053b2-666b-4773-93cd-c650b7fa5836 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:17.061716 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a7f93459-6b06-4ec4-a582-c3b3a5f62e8d tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Calling method '.version_select at 0x7f1181445ca0>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:17.097264 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-a7f93459-6b06-4ec4-a582-c3b3a5f62e8d tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] HTTP exception thrown: Volume 07d58160-16de-4314-baf2-6502c53b66ba could not be found. Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a7f93459-6b06-4ec4-a582-c3b3a5f62e8d tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Request method failure captured: Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba HTTP/1.1 Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6qyMnGQkfIXwQXNmYWbowu9yMJXozNMlui6_DrWrrO-BAkt8l2Njw29GPLSZxufgkyY01zJ29_b-OtUyJlhHBa4TpLDN4-YiB6HanlK1VoOK2JI17MVfRKjHWfCR2SnZyceby3lenZBebHAE1dTk1vl0sRdtIcQD1Z4COpH-sJw9OE Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: d0628ae5b7904b21958d59e93e659a17 Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesGetTestJSON-948534738 Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:17.099273 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_d0628ae5b7904b21958d59e93e659a17", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/d0628ae5b7904b21958d59e93e659a17"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0628ae5b7904b21958d59e93e659a17"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/d0628ae5b7904b21958d59e93e659a17"}]}] Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesGetTestJSON-948534738 Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: d0628ae5b7904b21958d59e93e659a17 Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesGetTestJSON-948534738 Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesGetTestJSON-948534738-project Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 8622855b67c045409adc0dfa52ce06b5 Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesGetTestJSON-948534738-project Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Volume 07d58160-16de-4314-baf2-6502c53b66ba could not be found. Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '07d58160-16de-4314-baf2-6502c53b66ba'} Sep 25 01:11:17.102403 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 07d58160-16de-4314-baf2-6502c53b66ba could not be found. (HTTP 404) (Request-ID: req-46197f71-3f68-49b0-90ad-ba2a80aebbcd) Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:17.104298 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 25 01:11:17.107042 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 07d58160-16de-4314-baf2-6502c53b66ba could not be found. Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 25 01:11:17.110497 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 07d58160-16de-4314-baf2-6502c53b66ba could not be found. Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 07d58160-16de-4314-baf2-6502c53b66ba could not be found. Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a7f93459-6b06-4ec4-a582-c3b3a5f62e8d tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] Returning 404 to user: Volume 07d58160-16de-4314-baf2-6502c53b66ba could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a7f93459-6b06-4ec4-a582-c3b3a5f62e8d tempest-VolumesGetTestJSON-948534738 tempest-VolumesGetTestJSON-948534738-project] 10.222.0.26 "GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba" status: 404 len: 109 microversion: 2.1 time: 0.043514 Sep 25 01:11:17.113148 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 494/999] 10.222.0.26 () {58 vars in 1245 bytes} [Sun Sep 25 01:11:17 2022] GET /compute/v2.1/os-volumes/07d58160-16de-4314-baf2-6502c53b66ba => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:41.951397 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:41.952005 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:41.953946 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=16,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:41.954593 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=44,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:41.961532 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:41.962017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:41.962450 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.963144 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:41.963597 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:41.964017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:41.990488 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e4a34d3e-cd96-4a40-baab-e6978fdeae9d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/ips" status: 200 len: 149 microversion: 2.1 time: 0.043118 Sep 25 01:11:41.991059 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 506/1000] 10.222.0.26 () {58 vars in 1248 bytes} [Sun Sep 25 01:11:41 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/ips => generated 149 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:43.337293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=11 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:43.338582 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=50 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:11:43.343749 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "23e5d08f-e78c-4662-97dd-951fd02221c5"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:43.346260 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:43.353911 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.354402 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.354840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.355542 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:43.355998 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:43.356462 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:43.646018 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-04f257f6-13c7-4dca-bdf7-40b1aa633320 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "POST /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.309296 Sep 25 01:11:43.646733 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 495/1001] 10.222.0.26 () {60 vars in 1323 bytes} [Sun Sep 25 01:11:43 2022] POST /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments => generated 194 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:46.021079 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:46.021675 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:46.028105 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.028615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.029061 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.029766 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.030240 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.030694 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.111684 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lazy-loading 'services' on Instance uuid d8770505-4fb4-4ca4-a04e-dc81a0770a3f {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:46.184786 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-70d86b6c-d6f2-4c2e-a91b-69a0826ee779 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments/23e5d08f-e78c-4662-97dd-951fd02221c5" status: 202 len: 0 microversion: 2.1 time: 0.167673 Sep 25 01:11:46.185461 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 507/1002] 10.222.0.26 () {58 vars in 1416 bytes} [Sun Sep 25 01:11:46 2022] DELETE /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments/23e5d08f-e78c-4662-97dd-951fd02221c5 => generated 0 bytes in 170 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 25 01:11:46.194759 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:46.197326 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:46.204996 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.205519 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.205962 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.206671 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:46.207128 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:46.207557 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:46.239178 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-12bf1514-2cd3-4bee-bcb8-aec59388b418 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048868 Sep 25 01:11:46.240521 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 496/1003] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:11:46 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:47.253640 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:47.255907 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:47.262639 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.263131 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.263570 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.264270 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.264749 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.265176 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.298242 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-70a75ec6-5417-43f8-885d-0842b1735fef tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049148 Sep 25 01:11:47.298810 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 508/1004] 10.222.0.26 () {58 vars in 1302 bytes} [Sun Sep 25 01:11:47 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 25 01:11:47.363021 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:47.363606 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:47.370322 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.370755 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.371297 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.371894 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.372343 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.372802 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.400766 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:11:47.484401 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f4b5e792-27fc-4703-b28c-cc5dfa2c75c8 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 204 len: 0 microversion: 2.1 time: 0.124845 Sep 25 01:11:47.485805 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 497/1005] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:47 2022] DELETE /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 25 01:11:47.493522 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:47.494175 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:47.501177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.501683 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.502114 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.502856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:47.503312 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:47.503795 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:47.644764 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:47.653372 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-adb1d027-f5b5-49b8-a99d-a66518fef49a tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1679 microversion: 2.1 time: 0.163759 Sep 25 01:11:47.653946 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 509/1006] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:47 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:48.678094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:48.678881 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:48.685486 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:48.685980 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:48.686420 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:48.687134 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:48.687586 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:48.688015 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:48.835381 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:48.844018 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-a69b8a4c-5dfb-4080-9c49-3e904756c073 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1679 microversion: 2.1 time: 0.170196 Sep 25 01:11:48.844646 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 498/1007] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:48 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1679 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:49.885645 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:49.886860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:49.893206 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:49.893697 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:49.894138 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:49.894905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:49.895310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:49.895734 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.039584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:50.050374 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-6e17e3e9-c701-4a39-a0a1-860c7da5bfca tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1679 microversion: 2.1 time: 0.168624 Sep 25 01:11:50.050987 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 510/1008] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:49 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1679 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:50.554232 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-eb29a82b-2ea1-43db-b6d0-77a6e6134f2c req-8e694fd6-68df-4516-8b47-a1a632c1ad1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d8770505-4fb4-4ca4-a04e-dc81a0770a3f", "name": "network-vif-deleted", "tag": "8932c24d-6a85-44cf-a827-ce7a13d1d518"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:11:50.566320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-eb29a82b-2ea1-43db-b6d0-77a6e6134f2c req-8e694fd6-68df-4516-8b47-a1a632c1ad1a service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:50.566805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-eb29a82b-2ea1-43db-b6d0-77a6e6134f2c req-8e694fd6-68df-4516-8b47-a1a632c1ad1a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:50.567243 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-eb29a82b-2ea1-43db-b6d0-77a6e6134f2c req-8e694fd6-68df-4516-8b47-a1a632c1ad1a service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:50.585012 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-eb29a82b-2ea1-43db-b6d0-77a6e6134f2c req-8e694fd6-68df-4516-8b47-a1a632c1ad1a service nova] Creating event network-vif-deleted:8932c24d-6a85-44cf-a827-ce7a13d1d518 for instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f on hv-cinder-maste Sep 25 01:11:50.591224 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-eb29a82b-2ea1-43db-b6d0-77a6e6134f2c req-8e694fd6-68df-4516-8b47-a1a632c1ad1a service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040636 Sep 25 01:11:50.592184 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 499/1009] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:11:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:11:51.076983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:51.078153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:51.091539 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.092071 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.092553 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.093289 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.093752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.094182 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.138760 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:51.139589 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:51.140034 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:51.141044 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lazy-loading 'fault' on Instance uuid d8770505-4fb4-4ca4-a04e-dc81a0770a3f {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:11:51.206590 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9d73ba36238f449dbe08d8888920510f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b388fc6841ed4e5598fba4e8856b7af5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:11:51.216985 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7a06a266-5f88-4e20-bf69-42e5f31678ff tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 200 len: 1330 microversion: 2.1 time: 0.144266 Sep 25 01:11:51.217986 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 511/1010] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:51 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 1330 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:11:52.259211 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:52.260072 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:52.267281 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.267761 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.268205 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:52.268972 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:52.269417 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:52.269848 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:52.288182 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f HTTP/1.1 Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:52.289901 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:52.291669 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'd8770505-4fb4-4ca4-a04e-dc81a0770a3f'} Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:52.293535 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:52.294916 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:52.296331 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:52.296331 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-3e4901a3-05cf-48bb-8bac-d937b7cc228d tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 404 len: 111 microversion: 2.1 time: 0.037646 Sep 25 01:11:52.296331 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 500/1011] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:52 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:52.301043 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-32e30432-6f16-45d3-bfb1-699920864b53 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '.version_select at 0x7f11813bd940>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:52.325557 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-32e30432-6f16-45d3-bfb1-699920864b53 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-581571451" status: 202 len: 0 microversion: 2.1 time: 0.028268 Sep 25 01:11:52.326715 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 512/1012] 10.222.0.26 () {58 vars in 1218 bytes} [Sun Sep 25 01:11:52 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-581571451 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:11:54.217070 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:54.217704 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:54.224683 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:54.225263 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:54.225773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:54.226540 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:54.227063 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:54.227556 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:54.245773 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f HTTP/1.1 Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:54.247281 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.249065 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'd8770505-4fb4-4ca4-a04e-dc81a0770a3f'} Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:54.253306 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.254854 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.257403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:54.257403 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-afe964ba-895c-43c2-b2e1-d3f8eb61ecf7 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 404 len: 111 microversion: 2.1 time: 0.035868 Sep 25 01:11:54.257403 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 501/1013] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:54 2022] DELETE /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:54.258692 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:54.259318 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: d8770505-4fb4-4ca4-a04e-dc81a0770a3f] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:54.266044 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:54.266536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:54.266973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:54.267677 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:54.268128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:54.268615 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:54.283085 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f HTTP/1.1 Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:54.284772 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.286849 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': 'd8770505-4fb4-4ca4-a04e-dc81a0770a3f'} Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:54.287744 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. Sep 25 01:11:54.289096 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:54.290272 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance d8770505-4fb4-4ca4-a04e-dc81a0770a3f could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:54.290272 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-145073bc-f6d9-4ba0-8f84-8667829c79b3 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f" status: 404 len: 111 microversion: 2.1 time: 0.032733 Sep 25 01:11:54.290272 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 513/1014] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:54 2022] GET /compute/v2.1/servers/d8770505-4fb4-4ca4-a04e-dc81a0770a3f => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:55.450650 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:55.452372 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:55.459300 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.459795 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.460238 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.460989 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.461446 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.461880 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.476325 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 HTTP/1.1 Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:55.477955 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.480112 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '6815476f-37aa-4fc5-a8d2-aee8955e5288'} Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:55.480956 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.482233 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.483943 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:55.483943 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1e1943d6-b3ce-41e4-9888-f093fe634841 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 404 len: 111 microversion: 2.1 time: 0.032637 Sep 25 01:11:55.483943 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 502/1015] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:55 2022] DELETE /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:55.490323 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:55.491519 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 6815476f-37aa-4fc5-a8d2-aee8955e5288] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:55.498736 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.499237 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.499679 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.500440 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.500920 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.501369 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.516178 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 HTTP/1.1 Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:55.517921 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.519433 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '6815476f-37aa-4fc5-a8d2-aee8955e5288'} Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:55.520610 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. Sep 25 01:11:55.522161 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.523275 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance 6815476f-37aa-4fc5-a8d2-aee8955e5288 could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:55.523275 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ba4f8d43-c723-4c6c-8188-70e931de6339 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288" status: 404 len: 111 microversion: 2.1 time: 0.035047 Sep 25 01:11:55.523275 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 514/1016] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:55 2022] GET /compute/v2.1/servers/6815476f-37aa-4fc5-a8d2-aee8955e5288 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:55.528915 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:55.529423 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:55.535965 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.536589 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.537076 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.537981 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.538394 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.538867 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.553957 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c HTTP/1.1 Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:55.555536 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.557231 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c'} Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:55.558019 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.559247 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.560520 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:55.560520 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e6f995e3-5ccd-4f1f-ab84-7d391efd30af tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 404 len: 111 microversion: 2.1 time: 0.032019 Sep 25 01:11:55.560520 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 503/1017] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:55 2022] DELETE /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:55.565860 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:55.566488 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:55.573030 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.573528 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.573988 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.574684 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:55.575145 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:55.575584 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:55.590721 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c HTTP/1.1 Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:55.592277 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.593941 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': 'b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c'} Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:55.594859 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. Sep 25 01:11:55.596265 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:55.597535 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:55.597535 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7a8072ec-8dd2-4cfc-826e-fd9fd49f2cc2 tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c" status: 404 len: 111 microversion: 2.1 time: 0.031693 Sep 25 01:11:55.597535 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 515/1018] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:55 2022] GET /compute/v2.1/servers/b755fcd2-68ce-40a0-a90c-1e8bcb0a4d6c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:11:56.764736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:56.765662 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:56.773600 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.774114 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.774564 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.775315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.775779 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.776221 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.792517 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: DELETE /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e HTTP/1.1 Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:11:56.794167 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.795813 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '7d9d047b-1796-4f02-96c1-94e475e3b55e'} Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:56.796909 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.798528 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.800346 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:56.800346 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-50725d14-ba05-4c94-85ed-101136144e7f tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "DELETE /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 404 len: 111 microversion: 2.1 time: 0.035385 Sep 25 01:11:56.800346 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 504/1019] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:11:56 2022] DELETE /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 25 01:11:56.810557 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:11:56.812024 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] [instance: 7d9d047b-1796-4f02-96c1-94e475e3b55e] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:11:56.823124 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.824017 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.824738 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.825993 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:11:56.826550 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:11:56.827730 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:11:56.853515 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.wsgi [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] HTTP exception thrown: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Request method failure captured: Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: request: GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e HTTP/1.1 Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept: application/json Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: Accept-Encoding: identity Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: Connection: close Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Length: 0 Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: Content-Type: application/json Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: Host: 10.222.0.26 Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: Openstack-System-Scope: None Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: User-Agent: python-urllib3/1.26.12 Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Auth-Token: gAAAAABjL6irnTy9DKhVnE7NOePez8Hj0x9bi1K5-tBGdMz6JKHIqv07MhwQiW9acRkGuwJ491-vUEhgYXvbU-ucHKhJ1uuUbippxTQsDhYW3T2TZ7GMEGxoG6PZ_YiOpNbQeJU1jjMNRPHuCI9ADK0Jz7Fd5gU1AkB-6CCei-gfQroc3X_KxrA Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Id: None Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Domain-Name: None Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Identity-Status: Confirmed Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Is-Admin-Project: True Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Id: default Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Domain-Name: Default Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Project-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Role: member,reader Sep 25 01:11:56.857152 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Roles: member,reader Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_b388fc6841ed4e5598fba4e8856b7af5", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/b388fc6841ed4e5598fba4e8856b7af5"}]}] Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Id: b388fc6841ed4e5598fba4e8856b7af5 Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-869013248 Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Id: default Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Domain-Name: Default Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Id: 9d73ba36238f449dbe08d8888920510f Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: X-User-Name: tempest-AttachVolumeNegativeTest-869013248-project Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: method: > Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: exception: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.860268 dv-cinder-master-3-smb devstack@n-api.service[120931]: action_args: {'id': '7d9d047b-1796-4f02-96c1-94e475e3b55e'} Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:11:56.863297 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. Sep 25 01:11:56.867067 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR nova.api.openstack.wsgi Sep 25 01:11:56.869574 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] Returning 404 to user: Instance 7d9d047b-1796-4f02-96c1-94e475e3b55e could not be found. {{(pid=120931) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:11:56.869574 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-863ca2a9-106a-4366-9a0f-d791c167f70b tempest-AttachVolumeNegativeTest-869013248 tempest-AttachVolumeNegativeTest-869013248-project] 10.222.0.26 "GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e" status: 404 len: 111 microversion: 2.1 time: 0.059270 Sep 25 01:11:56.869574 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 516/1020] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:11:56 2022] GET /compute/v2.1/servers/7d9d047b-1796-4f02-96c1-94e475e3b55e => generated 111 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:20.893000 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1394463032", "imageRef": "8712d659-350a-4361-afe1-bd3a3b065fff", "flavorRef": "452"}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:20.901729 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:20.902404 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=49,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:20.954525 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] validate_networks() for None {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:12:21.261552 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:12:21.261986 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:12:21.262464 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:12:21.262879 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:12:21.263329 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:12:21.273216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:21.273902 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:21.274533 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:21.275720 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:21.276509 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:21.277066 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:21.295055 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Getting quotas for project 6deb6ef4f6d747649d0fa8d98f12ec77. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:21.299006 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Getting quotas for user e21a593c324a4b94820dbdb3ae5a3ed0 and project 6deb6ef4f6d747649d0fa8d98f12ec77. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:21.311456 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:12:21.313666 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='8712d659-350a-4361-afe1-bd3a3b065fff',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:12:21.364870 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2aad782f-50e8-459e-ae46-158d8e8c0c98 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.475850 Sep 25 01:12:21.365528 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 505/1021] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:12:20 2022] POST /compute/v2.1/servers => generated 380 bytes in 477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:12:21.377479 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-78dace65-89c3-486f-a7a1-4266eebe0c33 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:21.378104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-78dace65-89c3-486f-a7a1-4266eebe0c33 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:21.381526 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:21.382366 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:21.448827 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-78dace65-89c3-486f-a7a1-4266eebe0c33 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:21.457209 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-78dace65-89c3-486f-a7a1-4266eebe0c33 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1215 microversion: 2.1 time: 0.083363 Sep 25 01:12:21.458362 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 517/1022] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:21 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:22.482034 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:22.482739 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:22.490425 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.490949 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.491397 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.492104 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:22.492617 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:22.493076 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:22.554721 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:22.562647 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-8a64ea29-a414-4851-847f-cbf6bbed9498 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1267 microversion: 2.1 time: 0.085089 Sep 25 01:12:22.563220 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 506/1023] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:22 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:23.587021 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:23.587782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:23.594575 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:23.595549 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:23.595831 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:23.596651 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:23.597160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:23.598103 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:23.790220 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:23.798533 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7a345cd4-1100-45a8-bc02-65b5fdf095b7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1315 microversion: 2.1 time: 0.215580 Sep 25 01:12:23.812858 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 518/1024] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:23 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:24.539231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-0d5ff5a7-4920-41fd-88fa-e17e1124ed04 req-d83417bb-33db-4f67-b891-7ee7aa7e1b5f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dc330fcb-a5e9-46ad-9689-f2a22062ed32", "tag": "108174f0-bb79-43ef-9bba-a632c8b3e4f8"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:24.558839 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0d5ff5a7-4920-41fd-88fa-e17e1124ed04 req-d83417bb-33db-4f67-b891-7ee7aa7e1b5f service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:24.559736 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0d5ff5a7-4920-41fd-88fa-e17e1124ed04 req-d83417bb-33db-4f67-b891-7ee7aa7e1b5f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:24.561383 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0d5ff5a7-4920-41fd-88fa-e17e1124ed04 req-d83417bb-33db-4f67-b891-7ee7aa7e1b5f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.592203 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-0d5ff5a7-4920-41fd-88fa-e17e1124ed04 req-d83417bb-33db-4f67-b891-7ee7aa7e1b5f service nova] Creating event network-changed:108174f0-bb79-43ef-9bba-a632c8b3e4f8 for instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 on hv-cinder-maste Sep 25 01:12:24.606001 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-0d5ff5a7-4920-41fd-88fa-e17e1124ed04 req-d83417bb-33db-4f67-b891-7ee7aa7e1b5f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.224817 Sep 25 01:12:24.607947 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 507/1025] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:24.821425 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:24.822048 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:24.829614 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:24.830115 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:24.830556 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.831273 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:24.832755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:24.832755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:24.995177 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:25.005159 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d67bec25-c727-46d6-bd1d-0ea265a7a1f6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1315 microversion: 2.1 time: 0.187549 Sep 25 01:12:25.005746 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 519/1026] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:24 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:26.031668 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:26.033073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:26.041859 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:26.042351 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:26.042791 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:26.043500 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:26.044038 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:26.044473 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:26.183790 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:26.192864 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-f266fc7e-8b4c-4fdd-9823-30c7d92aedd6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1315 microversion: 2.1 time: 0.167393 Sep 25 01:12:26.193440 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 508/1027] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:26 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:27.215280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:27.215985 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:27.223049 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.223587 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.224032 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:27.224884 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:27.225368 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:27.225816 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:27.366034 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:27.374052 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-435bb5c1-c283-467b-bbd5-7bd5466f2ccd tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1315 microversion: 2.1 time: 0.162806 Sep 25 01:12:27.374638 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 520/1028] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:27 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1315 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:28.398238 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:28.398858 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:28.406750 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:28.407277 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:28.407726 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:28.408567 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:28.412068 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:28.412068 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:28.542366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:28.550492 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-14d68e3a-6c09-4ae4-af24-cc81b556fea6 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1315 microversion: 2.1 time: 0.157001 Sep 25 01:12:28.551044 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 509/1029] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:28 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1315 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:29.573778 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:29.574505 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:29.581466 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.582529 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.583050 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.583789 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.584267 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.584935 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.746257 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:29.758785 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-dcd7a57d-2f48-4e9f-bcdb-898e4827e7c3 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1315 microversion: 2.1 time: 0.189067 Sep 25 01:12:29.759368 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 521/1030] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:29 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:29.807073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-83fef7a4-6d61-4efe-821f-635eb508f0aa req-1c4f8439-4a57-48bd-9676-ad4be5291c4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc330fcb-a5e9-46ad-9689-f2a22062ed32", "name": "network-vif-plugged", "status": "completed", "tag": "108174f0-bb79-43ef-9bba-a632c8b3e4f8"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:29.817350 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-83fef7a4-6d61-4efe-821f-635eb508f0aa req-1c4f8439-4a57-48bd-9676-ad4be5291c4f service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:29.817842 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-83fef7a4-6d61-4efe-821f-635eb508f0aa req-1c4f8439-4a57-48bd-9676-ad4be5291c4f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:29.818279 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-83fef7a4-6d61-4efe-821f-635eb508f0aa req-1c4f8439-4a57-48bd-9676-ad4be5291c4f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:29.830022 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-83fef7a4-6d61-4efe-821f-635eb508f0aa req-1c4f8439-4a57-48bd-9676-ad4be5291c4f service nova] Creating event network-vif-plugged:108174f0-bb79-43ef-9bba-a632c8b3e4f8 for instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 on hv-cinder-maste Sep 25 01:12:29.835102 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-83fef7a4-6d61-4efe-821f-635eb508f0aa req-1c4f8439-4a57-48bd-9676-ad4be5291c4f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.208953 Sep 25 01:12:29.835893 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 510/1031] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:30.783188 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:30.783881 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:30.791324 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:30.791811 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:30.792253 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:30.793031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:30.793488 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:30.793917 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:30.938693 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:30.947080 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-afc8c06b-3ed8-4e15-9bd3-dea3f37a2d07 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1315 microversion: 2.1 time: 0.167783 Sep 25 01:12:30.947658 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 522/1032] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:30 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:31.969563 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:31.970407 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:31.975772 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:31.976443 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:31.984122 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:31.984659 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:31.985137 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:31.985800 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:31.986255 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:31.986683 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.125975 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:32.134069 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-dde2eacb-220f-4d75-88c1-29a69c5e8ef5 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1465 microversion: 2.1 time: 0.166279 Sep 25 01:12:32.134648 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 511/1033] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:31 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1465 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:32.181746 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:32.182271 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:32.184133 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:32.190445 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.190973 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.191420 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.192156 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.192659 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.193093 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.219326 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Going to try to terminate instance {{(pid=120931) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:12:32.295926 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-ab0d8315-a078-4220-bb3a-475214746ab2 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "DELETE /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 204 len: 0 microversion: 2.1 time: 0.117198 Sep 25 01:12:32.296414 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 523/1034] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:12:32 2022] DELETE /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:12:32.305703 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:32.306347 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:32.313315 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.313817 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.314256 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.314974 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:32.315435 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:32.316576 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:32.465112 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:32.474536 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0222c987-04cf-4eec-a5d4-b74e1f40962d tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1471 microversion: 2.1 time: 0.173079 Sep 25 01:12:32.475132 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 512/1035] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:32 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1471 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:33.497983 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:33.498724 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:33.505825 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:33.506315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:33.506764 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:33.507466 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:33.508280 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:33.508752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:33.644703 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:33.652852 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e34af714-1982-48bd-b05e-3be65e21d4ca tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1471 microversion: 2.1 time: 0.159189 Sep 25 01:12:33.653432 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 524/1036] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:33 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1471 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:34.523881 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-2ad6e1de-952f-4353-8003-6cb7d75b841f req-bb2e4496-df0f-4b20-9f01-46afd0f0185e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dc330fcb-a5e9-46ad-9689-f2a22062ed32", "name": "network-vif-deleted", "tag": "108174f0-bb79-43ef-9bba-a632c8b3e4f8"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:34.534431 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-2ad6e1de-952f-4353-8003-6cb7d75b841f req-bb2e4496-df0f-4b20-9f01-46afd0f0185e service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.535182 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-2ad6e1de-952f-4353-8003-6cb7d75b841f req-bb2e4496-df0f-4b20-9f01-46afd0f0185e service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.536057 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-2ad6e1de-952f-4353-8003-6cb7d75b841f req-bb2e4496-df0f-4b20-9f01-46afd0f0185e service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.548140 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-2ad6e1de-952f-4353-8003-6cb7d75b841f req-bb2e4496-df0f-4b20-9f01-46afd0f0185e service nova] Creating event network-vif-deleted:108174f0-bb79-43ef-9bba-a632c8b3e4f8 for instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 on hv-cinder-maste Sep 25 01:12:34.563142 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-2ad6e1de-952f-4353-8003-6cb7d75b841f req-bb2e4496-df0f-4b20-9f01-46afd0f0185e service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041115 Sep 25 01:12:34.565030 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 513/1037] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:12:34.677128 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:34.677873 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:34.687808 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.688851 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.689817 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.691637 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.692297 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.692820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.737405 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:34.738331 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:34.738992 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:34.739685 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lazy-loading 'fault' on Instance uuid dc330fcb-a5e9-46ad-9689-f2a22062ed32 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:12:34.791843 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e21a593c324a4b94820dbdb3ae5a3ed0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6deb6ef4f6d747649d0fa8d98f12ec77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:12:34.800793 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-959f2c87-2144-4fb5-b908-f4d759d566d7 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 200 len: 1305 microversion: 2.1 time: 0.129275 Sep 25 01:12:34.801510 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 525/1038] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:34 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 1305 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:12:35.827410 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:12:35.828162 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] [instance: dc330fcb-a5e9-46ad-9689-f2a22062ed32] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:12:35.836796 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.837311 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.837751 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:35.838494 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:12:35.838964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:12:35.839391 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:12:35.854045 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] HTTP exception thrown: Instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 could not be found. Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Request method failure captured: Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 HTTP/1.1 Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6rzG1YVt43Z0MfsCDkdKcNvXDYYBCNpXLuc0R3QUfOYHne4PHPZ-74PLVzqFhTIE47BujOHgWDOV4hRpIFYIKXiFcPnE4cH7ROVanPLzHpxEBC-5Oa_wCv33rNCJgS4QZ6IVkpU6r0Ssf89HulQCdTSP6nbeZkEKfjsTQFRMMW2-g0 Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 6deb6ef4f6d747649d0fa8d98f12ec77 Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-VolumesNegativeTest-534978044 Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:12:35.855905 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_6deb6ef4f6d747649d0fa8d98f12ec77", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/6deb6ef4f6d747649d0fa8d98f12ec77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6deb6ef4f6d747649d0fa8d98f12ec77"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/6deb6ef4f6d747649d0fa8d98f12ec77"}]}] Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-VolumesNegativeTest-534978044 Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 6deb6ef4f6d747649d0fa8d98f12ec77 Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-VolumesNegativeTest-534978044 Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-VolumesNegativeTest-534978044-project Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: e21a593c324a4b94820dbdb3ae5a3ed0 Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-VolumesNegativeTest-534978044-project Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 could not be found. Sep 25 01:12:35.857968 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': 'dc330fcb-a5e9-46ad-9689-f2a22062ed32'} Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 could not be found. Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:12:35.858818 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 could not be found. Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 could not be found. Sep 25 01:12:35.860900 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:12:35.862213 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] Returning 404 to user: Instance dc330fcb-a5e9-46ad-9689-f2a22062ed32 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:12:35.862213 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-20afaabb-582a-4da9-b9f3-b77a7a454a09 tempest-VolumesNegativeTest-534978044 tempest-VolumesNegativeTest-534978044-project] 10.222.0.26 "GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32" status: 404 len: 111 microversion: 2.1 time: 0.034961 Sep 25 01:12:35.862213 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 514/1039] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:12:35 2022] GET /compute/v2.1/servers/dc330fcb-a5e9-46ad-9689-f2a22062ed32 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:12:51.274820 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:51.276258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=58,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:12:51.473075 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-dee8c147-2ab2-4db4-860e-2521c3ba89eb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Action: 'create', calling method: .version_select at 0x7f118146cca0>, body: {"keypair": {"name": "tempest-TestShelveInstance-319596999", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLDCImVfpnp5nYmgt5vj+obAcefvcrXGb0mW5A6ublnR7ARe43iXzPhbia8A19ETAI1KZDW6+bJ9S2nYXhh08EcWwNJWnPfleRPLv+nHuCFRxl/LYA41JQi7Rz3LENqTig=="}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:12:51.490283 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-dee8c147-2ab2-4db4-860e-2521c3ba89eb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Getting quotas for project 93735199d2524322a000a8f09ee05f7b. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:12:51.495187 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.quota [None req-dee8c147-2ab2-4db4-860e-2521c3ba89eb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Getting quotas for user 303c2c84cd274f25bd61faf0435add05 and project 93735199d2524322a000a8f09ee05f7b. Resources: {'key_pairs'} {{(pid=120931) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:12:51.520316 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-dee8c147-2ab2-4db4-860e-2521c3ba89eb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.252332 Sep 25 01:12:51.520954 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 526/1040] 10.222.0.26 () {60 vars in 1159 bytes} [Sun Sep 25 01:12:51 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 25 01:13:08.956667 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-554768768", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-319596999", "security_groups": [{"name": "tempest-secgroup-smoke-2142335800"}], "networks": [{"uuid": "41e1198b-6bae-461a-a8e6-9e4068b4166e"}], "block_device_mapping_v2": [{"uuid": "0cc62a2d-de7b-41df-ab80-1e07c4a2a9fc", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:08.967854 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:08.968536 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=40 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:09.101087 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.network.neutron [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] validate_networks() for [('41e1198b-6bae-461a-a8e6-9e4068b4166e', None, None, None, None, None)] {{(pid=120932) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 25 01:13:09.614751 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Flavor limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 25 01:13:09.615181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Image limits 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 25 01:13:09.615660 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Flavor pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 25 01:13:09.616073 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Image pref 0:0:0 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 25 01:13:09.616550 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.virt.hardware [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120932) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 25 01:13:09.628681 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.629180 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.629623 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.630370 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:09.630840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:09.631273 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:09.649441 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Getting quotas for project 93735199d2524322a000a8f09ee05f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 25 01:13:09.654094 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.quota [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Getting quotas for user 303c2c84cd274f25bd61faf0435add05 and project 93735199d2524322a000a8f09ee05f7b. Resources: {'instances', 'cores', 'ram'} {{(pid=120932) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 25 01:13:09.714449 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Going to run 1 instances... {{(pid=120932) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 25 01:13:09.716655 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0cc62a2d-de7b-41df-ab80-1e07c4a2a9fc',volume_size=None,volume_type=None)] {{(pid=120932) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 25 01:13:09.864560 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-34e4e0a8-141d-41e1-bec2-34a1cb8757ad tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.911048 Sep 25 01:13:09.864771 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 515/1041] 10.222.0.26 () {60 vars in 1147 bytes} [Sun Sep 25 01:13:08 2022] POST /compute/v2.1/servers => generated 406 bytes in 913 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 25 01:13:09.873258 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=4 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:09.874451 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:09.878446 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-fde3577e-c458-4e75-a4b5-eb77cbea0eb6 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:09.879322 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-fde3577e-c458-4e75-a4b5-eb77cbea0eb6 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:09.942548 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-fde3577e-c458-4e75-a4b5-eb77cbea0eb6 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:09.950291 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-fde3577e-c458-4e75-a4b5-eb77cbea0eb6 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1087 microversion: 2.1 time: 0.078364 Sep 25 01:13:09.950876 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 527/1042] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:09 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1087 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:10.976118 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:10.976830 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:10.984365 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.984893 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.985369 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:10.986715 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:10.987196 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:10.987653 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:11.088346 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:11.097153 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2343ea27-6a96-48e6-9ead-ca14ee176635 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1193 microversion: 2.1 time: 0.127183 Sep 25 01:13:11.098042 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 516/1043] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:10 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1193 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:12.120891 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:12.121453 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:12.128779 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.129279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.129727 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.130447 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.130917 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.131347 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.275805 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:12.284371 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-e3398805-e549-43cc-9358-5408e6a4cb9c tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.167638 Sep 25 01:13:12.284991 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 528/1044] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:12 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:12.578027 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-fe63fe6d-c476-4d39-b14a-385e53511e72 req-b9ae2007-2e37-4d29-a952-e2f946feb06f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c610cc-df2e-4919-b64d-b5cf4d386f90", "tag": "4d3f0f9d-f61e-41e5-8bd3-66681e4d6589"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:12.592339 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-fe63fe6d-c476-4d39-b14a-385e53511e72 req-b9ae2007-2e37-4d29-a952-e2f946feb06f service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:12.593392 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-fe63fe6d-c476-4d39-b14a-385e53511e72 req-b9ae2007-2e37-4d29-a952-e2f946feb06f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:12.594037 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-fe63fe6d-c476-4d39-b14a-385e53511e72 req-b9ae2007-2e37-4d29-a952-e2f946feb06f service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:12.610123 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-fe63fe6d-c476-4d39-b14a-385e53511e72 req-b9ae2007-2e37-4d29-a952-e2f946feb06f service nova] Creating event network-changed:4d3f0f9d-f61e-41e5-8bd3-66681e4d6589 for instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 on hv-cinder-maste Sep 25 01:13:12.616308 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-fe63fe6d-c476-4d39-b14a-385e53511e72 req-b9ae2007-2e37-4d29-a952-e2f946feb06f service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043769 Sep 25 01:13:12.617113 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 517/1045] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:13.313765 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:13.314439 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:13.321318 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.321812 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.322255 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.322967 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:13.323437 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:13.323868 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:13.467487 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:13.476912 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-333a9507-c969-4ea1-822d-4be1aecdf4b1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.167115 Sep 25 01:13:13.477493 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 529/1046] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:13 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:14.501793 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:14.502509 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:14.508824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.509320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.509763 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.510467 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:14.510924 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:14.511353 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:14.646746 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:14.655149 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d8533e72-6fe5-4d19-a1e7-00946bf5532a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.158024 Sep 25 01:13:14.655799 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 518/1047] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:14 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:15.679224 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:15.679856 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:15.686362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.686934 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.687279 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.687974 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:15.688446 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:15.688874 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:15.824143 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:15.831985 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-c558033f-9a9d-461d-8840-d3d4812c6e63 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.156645 Sep 25 01:13:15.832591 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 530/1048] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:15 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:16.854918 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:16.855610 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:16.861960 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.862441 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.862896 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:16.863580 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:16.864035 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:16.864489 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:17.010257 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:17.019679 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-6e1f7624-2249-457a-9a1b-bd8ea982c455 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.168763 Sep 25 01:13:17.020259 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 519/1049] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:16 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:18.042868 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:18.043486 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:18.050412 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.050908 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.051350 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.052070 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:18.052556 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:18.052986 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:18.215009 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:18.223169 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-468c9300-cf9f-469e-91af-5707684b1177 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.184164 Sep 25 01:13:18.223756 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 531/1050] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:18 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:13:19.246129 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:19.246745 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:19.253922 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.254416 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.254857 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.255563 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:19.256062 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:19.256524 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:19.397944 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:19.407006 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-ba544e3e-16f9-4cec-9f4d-7b7b5c6a3a62 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.164529 Sep 25 01:13:19.407608 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 520/1051] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:19 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:20.000503 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-98739157-c5b6-4988-b941-387098b27f9d req-0c1ca371-6746-4b9a-9eb6-d6e4c45d88f0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c610cc-df2e-4919-b64d-b5cf4d386f90", "name": "network-vif-plugged", "status": "completed", "tag": "4d3f0f9d-f61e-41e5-8bd3-66681e4d6589"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:20.006701 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell0:SELECT=2 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:20.013343 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-98739157-c5b6-4988-b941-387098b27f9d req-0c1ca371-6746-4b9a-9eb6-d6e4c45d88f0 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.013835 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-98739157-c5b6-4988-b941-387098b27f9d req-0c1ca371-6746-4b9a-9eb6-d6e4c45d88f0 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.014277 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-98739157-c5b6-4988-b941-387098b27f9d req-0c1ca371-6746-4b9a-9eb6-d6e4c45d88f0 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.026807 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-98739157-c5b6-4988-b941-387098b27f9d req-0c1ca371-6746-4b9a-9eb6-d6e4c45d88f0 service nova] Creating event network-vif-plugged:4d3f0f9d-f61e-41e5-8bd3-66681e4d6589 for instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 on hv-cinder-maste Sep 25 01:13:20.034575 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-98739157-c5b6-4988-b941-387098b27f9d req-0c1ca371-6746-4b9a-9eb6-d6e4c45d88f0 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038260 Sep 25 01:13:20.035526 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 532/1052] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:13:20.431289 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:20.431964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:20.433909 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=2 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:20.434582 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell0:SELECT=6 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:13:20.441482 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.441964 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.442400 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.443093 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:20.443546 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:20.443965 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:20.581735 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:20.589728 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2b84950d-1d85-4475-8c4a-11daf4ebc868 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.162337 Sep 25 01:13:20.590266 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 521/1053] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:20 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:21.615307 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:21.616010 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:21.622442 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.622937 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.623379 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.624083 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:21.624642 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:21.625100 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:21.768212 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:21.776531 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-b5180cef-e1dc-404c-8ddd-23d90bbf7f07 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1259 microversion: 2.1 time: 0.166663 Sep 25 01:13:21.777411 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 533/1054] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:21 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:22.799718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:22.800349 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:22.807099 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.807598 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.808040 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.809181 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.809307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.809662 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.944308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:22.952530 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-1e82586f-2e79-404b-973a-326afc57f8cb tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1442 microversion: 2.1 time: 0.156702 Sep 25 01:13:22.953115 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 522/1055] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:22 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1442 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:22.975153 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:13:22.975776 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:13:22.982410 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.982899 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.983342 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:22.984046 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:22.984535 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:22.984965 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:23.126940 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:13:23.135053 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-08787787-2788-4c4f-bbdc-ca6bf72a7327 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1442 microversion: 2.1 time: 0.163745 Sep 25 01:13:23.135630 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 534/1056] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:13:22 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1442 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:13:24.941098 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-8738b284-a482-4582-a37e-5a2f4a52a0e5 req-882c8ac7-c9fb-48f2-a6be-5a1e57a2e8f1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c610cc-df2e-4919-b64d-b5cf4d386f90", "tag": "4d3f0f9d-f61e-41e5-8bd3-66681e4d6589"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:13:24.950973 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-8738b284-a482-4582-a37e-5a2f4a52a0e5 req-882c8ac7-c9fb-48f2-a6be-5a1e57a2e8f1 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:13:24.951451 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-8738b284-a482-4582-a37e-5a2f4a52a0e5 req-882c8ac7-c9fb-48f2-a6be-5a1e57a2e8f1 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:13:24.951882 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-8738b284-a482-4582-a37e-5a2f4a52a0e5 req-882c8ac7-c9fb-48f2-a6be-5a1e57a2e8f1 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:13:24.963603 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-8738b284-a482-4582-a37e-5a2f4a52a0e5 req-882c8ac7-c9fb-48f2-a6be-5a1e57a2e8f1 service nova] Creating event network-changed:4d3f0f9d-f61e-41e5-8bd3-66681e4d6589 for instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 on hv-cinder-maste Sep 25 01:13:24.968828 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-8738b284-a482-4582-a37e-5a2f4a52a0e5 req-882c8ac7-c9fb-48f2-a6be-5a1e57a2e8f1 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031921 Sep 25 01:13:24.969440 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 523/1057] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:13:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:15:50.375131 dv-cinder-master-3-smb devstack@n-api.service[120931]: ERROR oslo.messaging._drivers.impl_rabbit [-] [459404a8-25aa-4e40-ac85-e5f82b591c50] AMQP server on 10.222.0.26:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 25 01:15:50.376508 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 01:15:50.376684 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sun Sep 25 01:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90/action (ip 10.222.0.26) !!! Sep 25 01:15:50.377612 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=18 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:50.378362 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=38 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:50.379325 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 01:15:50.379517 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sun Sep 25 01:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90/action (ip 10.222.0.26) !!! Sep 25 01:15:50.380589 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 01:15:50.380762 dv-cinder-master-3-smb devstack@n-api.service[120931]: Sun Sep 25 01:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90/action (ip 10.222.0.26) !!! Sep 25 01:15:50.385959 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:15:50.386495 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:50.398160 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.398656 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.399112 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.399838 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.400281 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.400741 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.429332 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.objects.instance [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lazy-loading 'flavor' on Instance uuid 96c610cc-df2e-4919-b64d-b5cf4d386f90 {{(pid=120931) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 25 01:15:50.507100 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2078e62f-9ade-41b1-8c1f-43c1ced98b40 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "POST /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90/action" status: 202 len: 0 microversion: 2.1 time: 0.133669 Sep 25 01:15:50.507707 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 535/1058] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:15:50 2022] POST /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90/action => generated 0 bytes in 135 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:15:50.514166 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR oslo.messaging._drivers.impl_rabbit [-] [11fe3e55-4911-4ac3-9be1-f2f119404d77] AMQP server on 10.222.0.26:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 25 01:15:50.515315 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 01:15:50.515443 dv-cinder-master-3-smb devstack@n-api.service[120932]: Sun Sep 25 01:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 (ip 10.222.0.26) !!! Sep 25 01:15:50.516578 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:50.517819 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=42 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:15:50.518860 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 25 01:15:50.519006 dv-cinder-master-3-smb devstack@n-api.service[120932]: Sun Sep 25 01:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 (ip 10.222.0.26) !!! Sep 25 01:15:50.520198 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 25 01:15:50.520351 dv-cinder-master-3-smb devstack@n-api.service[120932]: Sun Sep 25 01:15:50 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 (ip 10.222.0.26) !!! Sep 25 01:15:50.526923 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:50.528217 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:50.541988 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.544299 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.544299 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.544299 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:50.544840 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:50.545128 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:50.747170 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:50.755407 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-0ed81cb5-2e55-468d-a751-bbf69e3c1e7d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.243133 Sep 25 01:15:50.755987 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 524/1059] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:50 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:51.780051 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:51.780799 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:51.788241 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:51.788750 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:51.789190 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:51.789889 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:51.790347 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:51.790767 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:51.796825 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO oslo.messaging._drivers.impl_rabbit [-] [459404a8-25aa-4e40-ac85-e5f82b591c50] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 33448. Sep 25 01:15:51.975315 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:51.983799 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-9d5bc363-da6e-4f40-ac12-5efdbf21f724 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.209021 Sep 25 01:15:51.984366 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 536/1060] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:51 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:53.007089 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:53.007705 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:53.015805 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:53.016369 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:53.016888 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:53.017605 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:53.018063 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:53.018532 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:53.025004 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO oslo.messaging._drivers.impl_rabbit [-] [11fe3e55-4911-4ac3-9be1-f2f119404d77] Reconnected to AMQP server on 10.222.0.26:5672 via [amqp] client with port 33456. Sep 25 01:15:53.154325 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:53.162607 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-94983342-43cb-4b2c-8816-be976b933a4e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.159453 Sep 25 01:15:53.163189 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 525/1061] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:53 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:54.187135 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:54.187726 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:54.194154 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:54.194633 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:54.195067 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:54.195752 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:54.196200 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:54.196647 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:54.333004 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:54.341623 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-197b7c45-e819-4219-aa35-fb99f640ac61 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.158891 Sep 25 01:15:54.342219 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 537/1062] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:54 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:55.365691 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:55.366403 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:55.373756 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:55.374251 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:55.374691 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:55.375411 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:55.375864 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:55.376291 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:55.513352 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:55.521235 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-02fe30c8-fdb0-4da3-adcf-2934e0697dab tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.159447 Sep 25 01:15:55.521800 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 526/1063] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:55 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:56.544161 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:56.544811 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:56.551271 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:56.551755 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:56.552193 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:56.552919 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:56.553377 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:56.553807 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:56.684165 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:56.692166 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-bd43e418-7f48-40f4-8f63-3ce508fdceff tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.152404 Sep 25 01:15:56.692772 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 538/1064] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:56 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:57.716848 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:57.717392 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:57.724191 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.724719 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.725169 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.725873 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:57.726323 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:57.726757 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:57.869093 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:57.876788 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-20b4fe1d-756a-4546-8ae3-da595a19dd6a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.164654 Sep 25 01:15:57.877365 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 527/1065] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:57 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:15:58.900886 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:15:58.901492 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:15:58.908875 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:58.909197 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:58.909644 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:58.910344 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:15:58.911104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:15:58.911536 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:15:59.048111 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:15:59.056235 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-1fc8b04b-b4de-4c5b-9ab8-c3e7dcabd4c9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.159237 Sep 25 01:15:59.056889 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 539/1066] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:15:58 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:00.080197 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:00.080815 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:00.087274 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.087779 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.088216 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.088934 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:00.089388 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:00.089810 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:00.223786 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:00.232187 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d3486ef6-73fc-4167-9b9c-7654a3fcc095 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.155904 Sep 25 01:16:00.232788 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 528/1067] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:00 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:01.255252 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:01.255884 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:01.262599 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.263085 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.263525 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.264230 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:01.264715 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:01.265148 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:01.401377 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:01.410072 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-3fce2afd-3674-4a30-8863-400e0a6366dc tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.158702 Sep 25 01:16:01.410913 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 540/1068] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:01 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:02.435336 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:02.435954 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:02.442544 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.443022 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.443466 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.444154 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:02.444627 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:02.445051 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:02.585618 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:02.593880 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-9f2dd772-5c93-48d9-b133-5bdc82612fb1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.163174 Sep 25 01:16:02.594449 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 529/1069] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:02 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:03.618512 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:03.619041 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:03.625785 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.626269 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.626703 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.627391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.627841 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.628262 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.758897 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:03.767037 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-5326430d-f307-4926-be3e-5513ac3c040e tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1507 microversion: 2.1 time: 0.152385 Sep 25 01:16:03.767647 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 541/1070] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:03 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:03.790415 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:03.791019 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:03.798196 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.798690 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.799135 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.799841 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.800308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.800778 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.841582 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120932) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 25 01:16:03.910011 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2d708b1e-12b9-4add-863c-8255f5f5e889 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "POST /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90/action" status: 202 len: 0 microversion: 2.1 time: 0.123466 Sep 25 01:16:03.911183 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 530/1071] 10.222.0.26 () {60 vars in 1278 bytes} [Sun Sep 25 01:16:03 2022] POST /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90/action => generated 0 bytes in 126 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 25 01:16:03.920397 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:03.921088 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:03.926885 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.927370 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.927803 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:03.928525 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:03.928975 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:03.929392 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:04.066905 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:04.075629 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d3bb1ba7-e9dd-461d-9fae-7bc76d986ef9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1515 microversion: 2.1 time: 0.160065 Sep 25 01:16:04.076403 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 542/1072] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:03 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1515 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:05.099945 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:05.100519 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:05.107080 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.107570 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.108042 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.108780 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:05.109231 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:05.109657 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:05.242192 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:05.259134 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-2418ab3e-f86a-4787-ba20-f4814221112d tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1573 microversion: 2.1 time: 0.163311 Sep 25 01:16:05.259732 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 531/1073] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:05 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1573 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:16:06.283340 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:06.283952 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:06.290669 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:06.291140 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:06.291585 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.292269 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:06.293321 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:06.293744 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.428200 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:06.435950 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-47904871-53df-4271-a690-9a059f432e25 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1573 microversion: 2.1 time: 0.156493 Sep 25 01:16:06.436537 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 543/1074] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:06 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:06.683308 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-c8068f02-67ca-46e2-b0d8-1882361b1745 req-ae05f863-0c1a-453a-a494-365e1a6a9843 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c610cc-df2e-4919-b64d-b5cf4d386f90", "name": "network-vif-unplugged", "status": "completed", "tag": "4d3f0f9d-f61e-41e5-8bd3-66681e4d6589"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:06.694581 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c8068f02-67ca-46e2-b0d8-1882361b1745 req-ae05f863-0c1a-453a-a494-365e1a6a9843 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:06.695934 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c8068f02-67ca-46e2-b0d8-1882361b1745 req-ae05f863-0c1a-453a-a494-365e1a6a9843 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:06.696393 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-c8068f02-67ca-46e2-b0d8-1882361b1745 req-ae05f863-0c1a-453a-a494-365e1a6a9843 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:06.708643 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-c8068f02-67ca-46e2-b0d8-1882361b1745 req-ae05f863-0c1a-453a-a494-365e1a6a9843 service nova] Creating event network-vif-unplugged:4d3f0f9d-f61e-41e5-8bd3-66681e4d6589 for instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 on hv-cinder-maste Sep 25 01:16:06.715759 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-c8068f02-67ca-46e2-b0d8-1882361b1745 req-ae05f863-0c1a-453a-a494-365e1a6a9843 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.036030 Sep 25 01:16:06.716365 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 532/1075] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:06 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:16:07.460391 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:07.461030 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:07.467540 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:07.468031 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:07.468499 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:07.469202 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:07.469661 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:07.470099 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:07.603053 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:07.611506 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-d0e85927-ad1a-439e-a7f3-092316c5ebf1 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1573 microversion: 2.1 time: 0.155649 Sep 25 01:16:07.612077 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 544/1076] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:07 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:08.636887 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:08.637594 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:08.643901 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.644405 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.644843 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.645535 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:08.645991 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:08.646417 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:08.779537 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:08.787558 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-cef64147-8305-486a-b30a-0d1a674a21b9 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1573 microversion: 2.1 time: 0.156011 Sep 25 01:16:08.788123 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 533/1077] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:08 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:09.811104 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:09.811720 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:09.818271 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:09.818760 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:09.819203 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:09.819900 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:09.820355 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:09.820812 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:09.950897 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:09.958649 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-2a479e89-e36b-493a-8ef5-fbf621426d24 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1573 microversion: 2.1 time: 0.152158 Sep 25 01:16:09.959214 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 545/1078] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:09 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1573 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:10.983300 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:16:10.983886 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:16:10.990428 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.990917 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.991363 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:10.992067 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:10.992561 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:10.992993 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:11.130954 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:16:11.139433 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-e1a029d5-6f71-4726-8417-78dc583a2b22 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1560 microversion: 2.1 time: 0.160827 Sep 25 01:16:11.140026 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 534/1079] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:16:10 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1560 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:16:12.774226 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-a7c1848a-4364-442e-9ddb-9bacc00503e2 req-35b67e47-998f-4482-a1e0-64cb6ca8885d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c610cc-df2e-4919-b64d-b5cf4d386f90", "name": "network-vif-plugged", "status": "completed", "tag": "4d3f0f9d-f61e-41e5-8bd3-66681e4d6589"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:16:12.785543 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-a7c1848a-4364-442e-9ddb-9bacc00503e2 req-35b67e47-998f-4482-a1e0-64cb6ca8885d service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:16:12.786310 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-a7c1848a-4364-442e-9ddb-9bacc00503e2 req-35b67e47-998f-4482-a1e0-64cb6ca8885d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:16:12.786729 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-a7c1848a-4364-442e-9ddb-9bacc00503e2 req-35b67e47-998f-4482-a1e0-64cb6ca8885d service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:16:12.800201 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-a7c1848a-4364-442e-9ddb-9bacc00503e2 req-35b67e47-998f-4482-a1e0-64cb6ca8885d service nova] Creating event network-vif-plugged:4d3f0f9d-f61e-41e5-8bd3-66681e4d6589 for instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 on hv-cinder-maste Sep 25 01:16:12.805736 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-a7c1848a-4364-442e-9ddb-9bacc00503e2 req-35b67e47-998f-4482-a1e0-64cb6ca8885d service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035120 Sep 25 01:16:12.806552 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 546/1080] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:16:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:47.177111 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_api:SELECT=26,nova_api:UPDATE=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:47.179386 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG dbcounter [-] [120932] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120932) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:47.184831 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:47.185334 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:47.187863 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_api:SELECT=24 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:47.189285 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG dbcounter [-] [120931] Writing DB stats nova_cell1:SELECT=77,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120931) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 25 01:17:47.193284 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:47.194625 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:47.195320 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.197364 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:47.197836 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:47.198269 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.229522 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Going to try to terminate instance {{(pid=120932) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 25 01:17:47.287139 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [req-26b365e1-2fef-4fe7-89b5-e65aca52c03d req-79635fb9-1a42-45ed-b496-864bbe091ce9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "96c610cc-df2e-4919-b64d-b5cf4d386f90", "tag": "4d3f0f9d-f61e-41e5-8bd3-66681e4d6589"}]} {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:47.300911 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-26b365e1-2fef-4fe7-89b5-e65aca52c03d req-79635fb9-1a42-45ed-b496-864bbe091ce9 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:47.301764 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-26b365e1-2fef-4fe7-89b5-e65aca52c03d req-79635fb9-1a42-45ed-b496-864bbe091ce9 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:47.302197 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [req-26b365e1-2fef-4fe7-89b5-e65aca52c03d req-79635fb9-1a42-45ed-b496-864bbe091ce9 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.318278 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.compute.server_external_events [req-26b365e1-2fef-4fe7-89b5-e65aca52c03d req-79635fb9-1a42-45ed-b496-864bbe091ce9 service nova] Creating event network-changed:4d3f0f9d-f61e-41e5-8bd3-66681e4d6589 for instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 on hv-cinder-maste Sep 25 01:17:47.325594 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [req-26b365e1-2fef-4fe7-89b5-e65aca52c03d req-79635fb9-1a42-45ed-b496-864bbe091ce9 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.149374 Sep 25 01:17:47.329723 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-d57a4bca-ae5a-480b-8d23-25b8c9c4a8cd tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "DELETE /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 204 len: 0 microversion: 2.1 time: 0.153629 Sep 25 01:17:47.329723 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 535/1081] 10.222.0.26 () {58 vars in 1239 bytes} [Sun Sep 25 01:17:47 2022] DELETE /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 25 01:17:47.330442 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 547/1082] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:47.337881 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:47.338765 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:47.345293 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:47.345894 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:47.346399 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.347112 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:47.347565 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:47.347992 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:47.492619 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.policy [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120932) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:47.501565 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-bd13dea2-63b7-4dd3-a1a9-3995e869e56a tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.167910 Sep 25 01:17:47.502168 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 536/1083] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:47 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:48.527470 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:48.528211 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:48.534945 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.535438 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.535885 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.536893 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:48.537354 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:48.537783 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:48.679142 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:48.686968 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-7c4b0b4b-902f-47cc-8e1b-c6975f5b0e28 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1566 microversion: 2.1 time: 0.164917 Sep 25 01:17:48.687620 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 548/1084] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:48 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1566 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 25 01:17:49.606635 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [req-0e3946ce-33a5-4453-843b-731d2f068411 req-6b8be183-b51b-4148-bdd4-78bb26da0165 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "96c610cc-df2e-4919-b64d-b5cf4d386f90", "name": "network-vif-deleted", "tag": "4d3f0f9d-f61e-41e5-8bd3-66681e4d6589"}]} {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 25 01:17:49.617622 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0e3946ce-33a5-4453-843b-731d2f068411 req-6b8be183-b51b-4148-bdd4-78bb26da0165 service nova] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.618773 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0e3946ce-33a5-4453-843b-731d2f068411 req-6b8be183-b51b-4148-bdd4-78bb26da0165 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.619238 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [req-0e3946ce-33a5-4453-843b-731d2f068411 req-6b8be183-b51b-4148-bdd4-78bb26da0165 service nova] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.631652 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.compute.server_external_events [req-0e3946ce-33a5-4453-843b-731d2f068411 req-6b8be183-b51b-4148-bdd4-78bb26da0165 service nova] Creating event network-vif-deleted:4d3f0f9d-f61e-41e5-8bd3-66681e4d6589 for instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 on hv-cinder-maste Sep 25 01:17:49.636893 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [req-0e3946ce-33a5-4453-843b-731d2f068411 req-6b8be183-b51b-4148-bdd4-78bb26da0165 service nova] 10.222.0.26 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034587 Sep 25 01:17:49.637525 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 537/1085] 10.222.0.26 () {64 vars in 1317 bytes} [Sun Sep 25 01:17:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 25 01:17:49.710782 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:49.711922 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.compute.api [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120931) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:49.718336 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.718826 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.719263 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.719957 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:49.720439 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:49.720866 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG oslo_concurrency.lockutils [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120931) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:49.788491 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.policy [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '303c2c84cd274f25bd61faf0435add05', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '93735199d2524322a000a8f09ee05f7b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120931) authorize /opt/stack/nova/nova/policy.py:199}} Sep 25 01:17:49.799442 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-58425d49-e296-42bd-a084-c0939ba19e30 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 200 len: 1218 microversion: 2.1 time: 0.092486 Sep 25 01:17:49.800012 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 549/1086] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:49 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 1218 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 25 01:17:50.823720 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '>' {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:50.824504 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.compute.api [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] [instance: 96c610cc-df2e-4919-b64d-b5cf4d386f90] Fetching instance by UUID {{(pid=120932) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 25 01:17:50.830824 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.831307 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.831745 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.832477 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Acquiring lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 25 01:17:50.832934 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 25 01:17:50.833366 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG oslo_concurrency.lockutils [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Lock "2c40cf22-5cbd-4586-b2d3-96f125e105b5" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120932) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 25 01:17:50.847505 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.wsgi [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] HTTP exception thrown: Instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 could not be found. Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Request method failure captured: Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: request: GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 HTTP/1.1 Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept: application/json Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: Accept-Encoding: identity Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: Connection: close Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Length: 0 Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: Content-Type: application/json Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: Host: 10.222.0.26 Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: Openstack-System-Scope: None Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: User-Agent: python-urllib3/1.26.12 Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Auth-Token: gAAAAABjL6sNOycRQ7vF6v47awLyNwYEGEaQBHckyGit2zCYAy8Gt0Ds6xi8jpsy97H7J_RJwGiCQfRHSmZ79chWr_Xm2R3P6LzVMXAwuiBQ5EJo97jXPEtc_a9S08ieZZUjbKzJGJoiPqq5zsYsi4n3nKO8tlJMTm1RJtUAWOsTh_gBhSS8Xpc Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Id: None Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Domain-Name: None Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Identity-Status: Confirmed Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Is-Admin-Project: True Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Id: default Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Domain-Name: Default Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Id: 93735199d2524322a000a8f09ee05f7b Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Project-Name: tempest-TestShelveInstance-2068188961 Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Role: member,reader Sep 25 01:17:50.849194 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Roles: member,reader Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:8080/v1/AUTH_93735199d2524322a000a8f09ee05f7b", "adminURL": "http://10.222.0.26:8080"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2/93735199d2524322a000a8f09ee05f7b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/compute/v2.1"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26:9696/networking"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93735199d2524322a000a8f09ee05f7b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.26/volume/v3/93735199d2524322a000a8f09ee05f7b"}]}] Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant: tempest-TestShelveInstance-2068188961 Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Id: 93735199d2524322a000a8f09ee05f7b Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-Tenant-Name: tempest-TestShelveInstance-2068188961 Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User: tempest-TestShelveInstance-2068188961-project Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Id: default Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Domain-Name: Default Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Id: 303c2c84cd274f25bd61faf0435add05 Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: X-User-Name: tempest-TestShelveInstance-2068188961-project Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: method: > Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: exception: Instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 could not be found. Sep 25 01:17:50.850700 dv-cinder-master-3-smb devstack@n-api.service[120932]: action_args: {'id': '96c610cc-df2e-4919-b64d-b5cf4d386f90'} Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: {{(pid=120932) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 could not be found. Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 25 01:17:50.851600 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 could not be found. Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 could not be found. Sep 25 01:17:50.853231 dv-cinder-master-3-smb devstack@n-api.service[120932]: ERROR nova.api.openstack.wsgi Sep 25 01:17:50.854718 dv-cinder-master-3-smb devstack@n-api.service[120932]: DEBUG nova.api.openstack.wsgi [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Returning 404 to user: Instance 96c610cc-df2e-4919-b64d-b5cf4d386f90 could not be found. {{(pid=120932) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 25 01:17:50.854718 dv-cinder-master-3-smb devstack@n-api.service[120932]: INFO nova.api.openstack.requestlog [None req-5d68a21d-1163-46bc-b109-0307bd51f3b5 tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90" status: 404 len: 111 microversion: 2.1 time: 0.032623 Sep 25 01:17:50.854718 dv-cinder-master-3-smb devstack@n-api.service[120932]: [pid: 120932|app: 0|req: 538/1087] 10.222.0.26 () {58 vars in 1236 bytes} [Sun Sep 25 01:17:50 2022] GET /compute/v2.1/servers/96c610cc-df2e-4919-b64d-b5cf4d386f90 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 25 01:17:51.023129 dv-cinder-master-3-smb devstack@n-api.service[120931]: DEBUG nova.api.openstack.wsgi [None req-78c6fb75-4ab1-4ec3-908e-976899e29c2b tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] Calling method '.version_select at 0x7f118139fdc0>' {{(pid=120931) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 25 01:17:51.049055 dv-cinder-master-3-smb devstack@n-api.service[120931]: INFO nova.api.openstack.requestlog [None req-78c6fb75-4ab1-4ec3-908e-976899e29c2b tempest-TestShelveInstance-2068188961 tempest-TestShelveInstance-2068188961-project] 10.222.0.26 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-319596999" status: 202 len: 0 microversion: 2.1 time: 0.033369 Sep 25 01:17:51.052950 dv-cinder-master-3-smb devstack@n-api.service[120931]: [pid: 120931|app: 0|req: 550/1088] 10.222.0.26 () {58 vars in 1251 bytes} [Sun Sep 25 01:17:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-319596999 => generated 0 bytes in 38 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)